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Foreword 


Education and learning raise aspirations, set values, and ultimately enrich lives. The coun- 
try where I was born, the Republic of Korea, is a good example of how education can play 
these important roles. After the Korean War, the population was largely illiterate and deeply 
impoverished. The World Bank said that, without constant foreign aid, Korea would find it 
difficult to provide its people with more than the bare necessities of life. The World Bank 
considered even the lowest interest rate loans to the country too risky. 

Korea understood that education was the best way to pull itself out of economic misery, 
so it focused on overhauling schools and committed itself to educating every child—and 
educating them well. Coupled with smart, innovative government policies and a vibrant 
private sector, the focus on education paid off. Today, not only has Korea achieved universal 
literacy, but its students also perform at the highest levels in international learning assess- 
ments. It’s a high-income country and a model of successful economic development. 

Korea is a particularly striking example, but we can see the salutary effects of education 
in many countries. Delivered well, education—and the human capital it creates—has many 
benefits for economies, and for societies as a whole. For individuals, education promotes 
employment, earnings, and health. It raises pride and opens new horizons. For societies, it 
drives long-term economic growth, reduces poverty, spurs innovation, strengthens institu- 
tions, and fosters social cohesion. 

In short, education powerfully advances the World Bank Group’s twin strategic goals: 
ending extreme poverty and boosting shared prosperity. Given that today’s students will be 
tomorrow’s citizens, leaders, workers, and parents, a good education is an investment with 
enduring benefits. 

But providing education is not enough. What is important, and what generates a real 
return on investment, is learning and acquiring skills. This is what truly builds human 
capital. As this year’s World Development Report documents, in many countries and commu- 
nities learning isn’t happening. Schooling without learning is a terrible waste of precious 
resources and of human potential. 

Worse, it is an injustice. Without learning, students will be locked into lives of poverty 
and exclusion, and the children whom societies fail the most are those most in need of 
a good education to succeed in life. Learning conditions are almost always much worse 
for the disadvantaged, and so are learning outcomes. Moreover, far too many children still 
aren't even attending school. This is a moral and economic crisis that must be addressed 
immediately. 

This year’s Report provides a path to address this economic and moral failure. The 
detailed analysis in this Report shows that these problems are driven not only by service 
delivery failings in schools but also by deeper systemic problems. The human capital lost 
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FOREWORD 


because of these shortcomings threatens development and jeopardizes the future of peo- 
ple and their societies. At the same time, rapid technological change raises the stakes: to 
compete in the economy of the future, workers need strong basic skills and foundations for 
adaptability, creativity, and lifelong learning. 

To realize education’s promise, we need to prioritize learning, not just schooling. This 
Report argues that achieving learning for all will require three complementary strategies: 


* First, assess learning to make it a serious goal. Information itself creates incentives 
for reform, but many countries lack the right metrics to measure learning. 


* Second, act on evidence to make schools work for learning. Great schools build 
strong teacher-learner relationships in classrooms. As brain science has advanced 
and educators have innovated, the knowledge of how students learn most 
effectively has greatly expanded. But the way many countries, communities, 
and schools approach education often differs greatly from the most promising, 
evidence-based approaches. 


* Third, align actors to make the entire system work for learning. Innovation in 
classrooms won't have much impact if technical and political barriers at the sys- 
tem level prevent a focus on learning at the school level. This is the case in many 
countries stuck in low-learning traps; extricating them requires focused attention 
on the deeper causes. 


The World Bank Group is already incorporating the key findings of this Report into our 
operations. We will continue to seek new ways to scale up our commitment to education 
and apply our knowledge to serve those children whose untapped potential is wasted. For 
example, we are developing more useful measures of learning and its determinants. We 
are ensuring that evidence guides operational practice to improve learning in areas such as 
early-years interventions, teacher training, and educational technology. We are making 
sure that our project analysis and strategic country diagnoses take into account the full 
range of system-level opportunities and limitations—including political constraints. And 
we will continue to emphasize operational approaches that allow greater innovation and 
agility. 

Underlying these efforts is the World Bank Group’s commitment to ensuring that all of 
the world’s students have the opportunity to learn. Realizing education’s promise means 
giving them the chance not only to compete in tomorrow's economy, but also to improve 
their communities, build stronger countries, and move closer to a world that is finally free 
of poverty. 


Jim Yong Kim 
President 
The World Bank Group 
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OVERVIEW 


Learning to realize 
education’s promise 


“Education is the most powerful weapon we can use to change the world.” 


NELSON MANDELA (2003) 


“If your plan is for one year, plant rice. If your plan is for ten years, plant trees. 
If your plan is for one hundred years, educate children.” 


KUAN CHUNG (7TH CENTURY BC) 


Schooling is not the same as learning. In Kenya, 
Tanzania, and Uganda, when grade 3 students were 
asked recently to read a sentence such as “The 
name of the dog is Puppy,’ three-quarters did not 
understand what it said. In rural India, just under 
three-quarters of students in grade 3 could not solve 
a two-digit subtraction such as 46 - 17, and by grade 
5 half could still not do so.” Although the skills of 
Brazilian 15-year-olds have improved, at their cur- 
rent rate of improvement they won't reach the rich- 
country average score in math for 75 years. In reading, 
it will take more than 260 years.3 Within countries, 
learning outcomes are almost always much worse 
for the disadvantaged. In Uruguay, poor children in 
grade 6 are assessed as “not competent” in math at 
five times the rate of wealthy children.* Moreover, 
such data are for children and youth lucky enough to 
be in school. Some 260 million aren't even enrolled in 
primary or secondary school. 

These countries are not unique in the challenges 
they face. (In fact, they deserve credit for measuring 
student learning and making the results public.) 
Worldwide, hundreds of millions of children reach 
young adulthood without even the most basic life 
skills. Even if they attend school, many leave without 
the skills for calculating the correct change from a 


transaction, reading a doctor's instructions, or inter- 
preting a campaign promise—let alone building a 
fulfilling career or educating their children. 

This learning crisis is a moral crisis. When deliv- 
ered well, education cures a host of societal ills. 
For individuals, it promotes employment, earnings, 
health, and poverty reduction. For societies, it spurs 
innovation, strengthens institutions, and fosters 
social cohesion. But these benefits depend largely 
on learning. Schooling without learning is a wasted 
opportunity. More than that, it is a great injustice: 
the children whom society is failing most are the ones 
who most need a good education to succeed in life. 

Any country can do better if it acts as though learn- 
ing really matters. That may sound obvious—after 
all, what else is education for? Yet even as learning 
goals are receiving greater rhetorical support, in 
practice many features of education systems conspire 
against learning. This Report argues that countries 
can improve by advancing on three fronts: 


* Assess learning—to make it a serious goal. This 
means using well-designed student assessments 
to gauge the health of education systems (not 
primarily as tools for administering rewards and 
punishments). It also means using the resulting 
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learning measures to spotlight hidden exclu- 
sions, make choices, and evaluate progress. 

* Act onevidence—to make schools work for all learners. 
Evidence on how people learn has exploded in 
recent decades, along with an increase in edu- 
cational innovation. Countries can make much 
better use of this evidence to set priorities for 
their own practice and innovations. 

* Align actors—to make the whole system work for 
learning. Countries must recognize that all the 
classroom innovation in the world is unlikely to 
have much impact if, because of technical and 
political barriers, the system as a whole does not 
support learning. By taking into account these 
real-world barriers and mobilizing everyone who 
has a stake in learning, countries can support 
innovative educators on the front lines. 


When improving learning becomes a priority, 
great progress is possible. In the early 1950s, the 
Republic of Korea was a war-torn society held back by 
very low literacy levels. By 1995 it had achieved uni- 
versal enrollment in high-quality education through 
secondary school. Today, its young people perform at 
the highest levels on international learning assess- 
ments. Vietnam surprised the world when the 2012 
results of the Programme for International Student 
Assessment (PISA) showed that its 15-year-olds were 
performing at the same level as those in Germany— 
even though Vietnam was a lower-middle-income 
country. Between 2009 and 2015, Peru achieved some 
of the fastest growth in overall learning outcomes—an 
improvement attributable to concerted policy action. 
In Liberia, Papua New Guinea, and Tonga, early grade 
reading improved substantially within a very short 
time thanks to focused efforts based on evidence. And 
recently, Malaysia and Tanzania launched promising 
societywide collaborative approaches to systemati- 
cally improving learning. 

Progress like this requires a clear-eyed diagnosis, 
followed by concerted action. Before showing what 
can be done to fulfill education's promise, this over- 
view first shines a light on the learning crisis: how 
and why many countries are not yet achieving “learn- 
ing for all.” This may make for disheartening reading, 
but it should not be interpreted as saying that all is 
lost—only that too many young people are not getting 
the education they need. The rest of the overview 
shows how change is possible if systems commit to 
“all for learning,” drawing on examples of families, 
educators, communities, and systems that have made 
real progress. 
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The three dimensions of the 
learning crisis 


Education should equip students with the skills they 
need to lead healthy, productive, meaningful lives. 
Different countries define skills differently, but 
all share some core aspirations, embodied in their 
curriculums. Students everywhere must learn how 
to interpret many types of written passages—from 
medication labels to job offers, from bank statements 
to great literature. They have to understand how 
numbers work so that they can buy and sell in mar- 
kets, set family budgets, interpret loan agreements, 
or write engineering software. They require the 
higher-order reasoning and creativity that builds on 
these foundational skills. And they need the socio- 
emotional skills—such as perseverance and the ability 
to work on teams—that help them acquire and apply 
the foundational and other skills. 

Many countries are not yet achieving these goals. 
First, the learning that one would expect to happen 
in schools—whether expectations are based on formal 
curriculums, the needs of employers, or just common 
sense—is often not occurring. Of even greater con- 
cern, many countries are failing to provide learning 
for all. Individuals already disadvantaged in society— 
whether because of poverty, location, ethnicity, gen- 
der, or disability—learn the least. Thus education 
systems can widen social gaps instead of narrowing 
them. What drives the learning shortfalls is becoming 
clearer thanks to new analyses spotlighting both the 
immediate cause—poor service delivery that ampli- 
fies the effects of poverty—and the deeper system- 
level problems, both technical and political, that allow 
poor-quality schooling to persist. 


Learning outcomes are poor: Low levels, 
high inequality, slow progress 
The recent expansion in education 
is impressive by historical stan- 
dards. In many developing coun- 
tries over the last few decades, net 
enrollment in education has greatly 
outpaced the historic performance 
of today’s industrial countries. For 


: . Problem 
example, it took the United States ; = 
f pace : dimension 1: 
40 years—from 1870 to 1910—to Guteomes 


increase girls’ enrollments from 57 

percent to 88 percent. By contrast, Morocco achieved 
a similar increase in just 11 years.° The number of 
years of schooling completed by the average adult in 
the developing world more than tripled from 1950 to 


Figure O.1 Shortfalls in learning start early 


Percentage of grade 2 students who could not perform simple reading or math tasks, selected countries 
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Sources: WDR 2018 team, using reading and mathematics data for Kenya and Uganda from Uwezo, Annual Assessment Reports, 2015 (http://www.uwezo 
-net/); reading and mathematics data for rural India from ASER Centre (2017); reading data for all other countries from U.S. Agency for International 
Development (USAID), Early Grade Reading Barometer, 2017, accessed May 30, 2017 (http://www.earlygradereadingbarometer.org/); and mathematics 
data for all other countries from USAID/RTI Early Grade Mathematics Assessment intervention reports, 2012-15 (https://shared.rti.org/sub-topic/early 


-grade-math-assessment-egma). Data at http://bit.do/WDR2018-Fig_O-1. 


Note: These data typically pertain to selected regions in the countries and are not necessarily nationally representative. Data for India pertain to rural areas. 


2010, from 2.0 to 7.2 years.’ By 2010 the average worker 
in Bangladesh had completed more years of school- 
ing than the typical worker in France in 1975.° This 
progress means that most enrollment gaps in basic 
education are closing between high- and low-income 
countries. By 2008 the average low-income country 
was enrolling students in primary school at nearly 
the same rate as the average high-income country. 

But schooling is not the same as learning.’ Chil- 
dren learn very little in many education systems 
around the world: even after several years in school, 
millions of students lack basic literacy and numeracy 
skills. In recent assessments in Ghana and Malawi, 
more than four-fifths of students at the end of grade 2 
were unable to read a single familiar word such 
as the or cat (figure O.1).° Even in Peru, a middle- 
income country, that share was half before the recent 
reforms.” When grade 3 students in Nicaragua were 
tested in 2011, only half could correctly solve 5 + 6.” 
In urban Pakistan in 2015, only three-fifths of grade 3 
students could correctly perform a subtraction such 
as 54 - 25, and in rural areas only just over two-fifths 
could.’ 

This slow start to learning means that even stu- 
dents who make it to the end of primary school do not 
master basic competencies. In 2007, the most recent 
year for which data are available, less than 50 percent 


of grade 6 students in Southern and East Africa were 
able to go beyond the level of simply deciphering 
words, and less than 40 percent got beyond basic 
numeracy.“ Among grade 6 students in West and 
Central Africa in 2014, less than 45 percent reached 
the “sufficient” competency level for continuing stud- 
ies in reading or mathematics—for example, the rest 
could not answer a math problem that required them 
to divide 130 by 26." In rural India in 2016, only half of 
grade 5 students could fluently read text at the level 
of the grade 2 curriculum, which included sentences 
(in the local language) such as “It was the month 
of rains” and “There were black clouds in the sky.” 
These severe shortfalls constitute a learning crisis. 
Although not all developing countries suffer from 
such extreme shortfalls, many are far short of the lev- 
els they aspire to. According to leading international 
assessments of literacy and numeracy—Progress in 
International Reading Literacy Study (PIRLS) and 
Trends in International Mathematics and Science 
Study (TIMSS)—the average student in low-income 
countries performs worse than 95 percent of the stu- 
dents in high-income countries, meaning that student 
would be singled out for remedial attention in a class 
in high-income countries.” Many high-performing 
students in middle-income countries—young men 
and women who have risen to the top quarter of 
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Figure O.2 In several countries, the 75th percentile of PISA test takers performs below 


the 25th percentile of the OECD average 


Performance of 25th, 50th, and 75th percentiles in 2015 PISA mathematics assessment, selected countries 
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Source: WDR 2018 team, using data from Programme for International Student Assessment (PISA) 2015 (OECD 2016). Data at http://bit.do/WDR2018-Fig_O-2. 


their cohorts—would rank in the bottom quarter in a 
wealthier country. In Algeria, the Dominican Republic, 
and Kosovo, the test scores of students at the cutoff 
for the top quarter of students (the 75th percentile of 
the distribution of PISA test takers) are well below the 
cutoff for the bottom quarter of students (25th per- 
centile) of Organisation for Economic Co-operation 
and Development (OECD) countries (figure O.2). Even 
in Costa Rica, a relatively strong performer in educa- 
tion, performance at the cutoff for the top quarter of 
students is equal to performance at the cutoff for the 
bottom quarter in Germany. 

The learning crisis amplifies inequality: it severely 
hobbles the disadvantaged youth who most need the 
boost that a good education can offer. For students in 
many African countries, the differences by income 
level are stark (figure O.3). In a recent assessment 
(Programme d’Analyse des Systémes Educatifs de la 
Confemen, PASEC, 2014) administered at the end of 
the primary cycle, only 5 percent of girls in Camer- 
oon from the poorest quintile of households had 
learned enough to continue school, compared with 76 
percent of girls from the richest quintile."? Learning 
gaps in several other countries—Benin, the Republic 
of Congo, and Senegal—were nearly as wide. Large 
gaps among learners afflict many high- and middle- 
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income countries as well, with disadvantaged stu- 
dents greatly overrepresented among the low scorers. 
Costa Rica and Qatar have the same average score on 
one internationally benchmarked assessment (TIMSS 
2015)—but the gap between the top and bottom quar- 
ters of students is 138 points in Qatar, compared with 
92 points in Costa Rica. The gap between the top and 
bottom quarters in the United States is larger than 
the gap in the median scores between Algeria and the 
United States. 

Students often learn little from year to year, but 
early learning deficits are magnified over time. Stu- 
dents who stay in school should be rewarded with 
steady progress in learning, whatever disadvantages 
they have in the beginning. And yet in Andhra Pradesh, 
India, in 2010, low-performing students in grade 5 
were no more likely to answer a grade 1 question cor- 
rectly than those in grade 2. Even the average student 
in grade 5 had about a 50 percent chance of answering 
a grade 1 question correctly—compared with about 40 
percent in grade 2.” In South Africa in the late 2000s, 
the vast majority of students in grade 4 had mastered 
only the mathematics curriculum from grade 1; most 
of those in grade 9 had mastered only the mathemat- 
ics items from grade 5.”° In New Delhi, India, in 2015, 
the average grade 6 student performed at a grade 3 


Figure O.3 Children from poor households in Africa typically learn much less 


Percentage of grade 6 PASEC test takers in 2014 who scored above (blue) and below (orange) the sufficiency level on reading achievement: poorest 


and richest quintiles by gender, selected countries 
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Source: WDR 2018 team, using data from World Bank (2016b). Data at http://bit.do/WDR2018-Fig_0O-3. 


Note: Socioeconomic quintiles are defined nationally. “Not competent” refers to levels 0-2 in the original coding and is considered below the sufficiency level for school continuation; “low 
competency” refers to level 3; and “high competency” refers to level 4. F = female; M = male; PASEC = Programme d’Analyse des Systemes Educatifs de la Confemen. 


level in math. Even by grade 9, the average student 
had reached less than a grade 5 level, and the gap 
between the better and worse performers grew over 
time (figure O.4). In Peru and Vietnam—one of the low- 
est and one of the highest performers, respectively, on 
the PISA assessment of 15-year-old students—5-year- 
olds start out with similar math skills, but students 
in Vietnam learn much more for each year of school- 
ing at the primary and lower secondary levels.” 

Although some countries are making progress 
on learning, their progress is typically slow. Even the 
middle-income countries that are catching up to the 
top performers are doing so very slowly. Indonesia 
has registered significant gains on PISA over the last 
10-15 years. And yet, even assuming it can sustain its 
2003-15 rate of improvement, Indonesia won't reach 
the OECD average score in mathematics for another 
48 years; in reading, for 73. For other countries, the 
wait could be even longer: based on current trends, 
it would take Tunisia over 180 years to reach the 
OECD average for math and Brazil over 260 years 
to reach the OECD average for reading. Moreover, 
these calculations are for countries where learning 
has improved. Across all countries participating in 
multiple rounds of PISA since 2003, the median gain 
in the national average score from one round to the 
next was zero. 


Figure O.4 Students often learn little from year 
to year, and early learning deficits are magnified 
over time 


Assessed grade-level performance of students relative to enrolled grade, 
New Delhi, India (2015) 
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Source: WDR 2018 team, using data from Muralidharan, Singh, and Ganimian (2016). Data at http://bit.do 
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Figure O.5 The percentage of primary school students who pass a minimum proficiency 
threshold is often low 


Median percentage of students in late primary school who score above a minimum proficiency level on a learning assessment, by income group and 
region 
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Source: WDR 2018 team, using “A Global Data Set on Education Quality” (2017), made available to the team by Nadir Altinok, Noam Angrist, and Harry Anthony Patrinos. Data at http://bit.do 
/WDR2018-Fig_0-5. 


Note: Bars show the unweighted cross-country median within country grouping. Regional averages exclude high-income countries. India and China are among the countries excluded 

for lack of data. Minimum proficiency in mathematics is benchmarked to the Trends in International Mathematics and Science Study (TIMSS) assessment and in reading to the Progress in 
International Reading Literacy Study (PIRLS) assessment. Minimum proficiency in mathematics means that students have some basic mathematical knowledge such as adding or subtracting 
whole numbers, recognizing familiar geometric shapes, and reading simple graphs and tables (Mullis and others 2016). Minimum proficiency in reading means that students can locate and 
retrieve explicitly stated detail when reading literary texts and can locate and reproduce explicitly stated information from the beginning of informational texts (Mullis and others 2012). 


Because of this slow progress, more than 60 per- 
cent of primary school children in developing coun- 
tries still fail to achieve minimum proficiency in learn- 
ing, according to one benchmark. No single learning 
assessment has been administered in all countries, 
but combining data from learning assessments in 95 
countries makes it possible to establish a globally com- 
parable “minimum proficiency” threshold in math.” 
Below this threshold, students have not mastered even 
basic mathematical skills, whether making simple 
computations with whole numbers, using fractions 
or measurements, or interpreting simple bar graphs. 
In high-income countries, nearly all students—99 per- 
cent in Japan, 98 percent in Norway, 91 percent in Aus- 
tralia—achieve this level in primary school.” But in 
other parts of the world the share is much lower: just 
7 percent in Mali, 30 percent in Nicaragua, 34 percent 
in the Philippines, and 76 percent in Mexico. In low- 
income countries, 14 percent of students reach this 
level near the end of primary school, and in lower- 
middle-income countries 37 percent do (figure O.5). 
Even in upper-middle-income countries only 61 per- 
cent reach this minimum proficiency. 

The ultimate barrier to learning is no schooling at 
all—yet hundreds of millions of youth remain out of 
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school. In 2016, 61 million children of primary school 
age—1o percent of all children in low- and lower- 
middle-income countries—were not in school, along 
with 202 million children of secondary school age.* 
Children in fragile and conflict-affected countries 
accounted for just over a third of these, a dispropor- 
tionate share. In the Syrian Arab Republic, which 
achieved universal primary enrollment in 2000, the 
civil war had driven 1.8 million children out of school 
by 2013.5 Almost all developing countries still have 
pockets of children from excluded social groups who 
do not attend school. Poverty most consistently pre- 
dicts failing to complete schooling, but other charac- 
teristics such as gender, disability, caste, and ethnicity 
also frequently contribute to school participation 
shortfalls (figure 0.6). 

But it’s not just poverty and conflict that keep 
children out of school; the learning crisis does, too. 
When poor parents perceive education to be of low 
quality, they are less willing to sacrifice to keep their 
children in school—a rational response, given the 
constraints they face.” Although parental perceptions 
of school quality depend on various factors, from the 
physical condition of schools to teacher punctuality, 
parents consistently cite student learning outcomes 


Figure O.6 School completion is higher for richer and urban families, but gender gaps are more 


context-dependent 


Gaps in grade 6 completion rates (percent) for 15- to 19-year-olds, by wealth, location, and gender 
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Note: The data presented are the latest available by country, 2005-14. Each vertical line indicates the size and direction of the gap for a country. 


as a critical component.”” These outcomes can affect 
behavior: holding student ability constant, students 
in the Arab Republic of Egypt who attended poorer- 
performing schools were more likely to drop out.” 

Learning shortfalls during the school years even- 
tually show up as weak skills in the workforce. Thus 
the job skills debate reflects the learning crisis. Work 
skill shortages are often discussed in a way that is 
disconnected from the debate on learning, but the 
two are parts of the same problem. Because education 
systems have not prepared workers adequately, many 
enter the labor force with inadequate skills. Measur- 
ing adult skills in the workplace is hard, but recent 
initiatives have assessed a range of skills in the adult 
populations of numerous countries. They found that 
even foundational skills such as literacy and numer- 
acy are often low, let alone the more advanced skills. 
The problem isn’t just a lack of trained workers; it is 
a lack of readily trainable workers. Accordingly, many 
workers end up in jobs that require minimal amounts 
of reading or math.” Lack of skills reduces job quality, 
earnings, and labor mobility. 

The skills needed in labor markets are multi- 
dimensional, so systems need to equip students with 
far more than just reading, writing, and math—but 
students cannot leapfrog these foundational skills. 
Whether as workers or members of society, peo- 
ple also need higher-order cognitive skills such as 
problem-solving. In addition, they need socioemo- 
tional skills—sometimes called soft or noncognitive 
skills—such as conscientiousness. Finally, they need 
technical skills to perform a specific job. That said, 


the foundational cognitive skills are essential, and 
systems cannot bypass the challenges of developing 
them as they target higher-order skills. 

Tackling the learning crisis and skills gaps requires 
diagnosing their causes—both their immediate causes 
at the school level and their deeper systemic drivers. 
Given all the investments countries have made in 
education, shortfalls in learning are discouraging. But 
one reason for them is that learning has not always 
received the attention it should have. As a result, 
stakeholders lack actionable information about what 
is going wrong in their schools and in the broader 
society, and so they cannot craft context-appropriate 
responses to improve learning. Acting effectively 
requires first understanding how schools are failing 
learners and how systems are failing schools. 


Schools are failing learners 
Struggling education systems lack 
one or more of four key school-level 
ingredients for learning: prepared 
learners, effective teaching, learning- 
focused inputs, and the skilled man- 
agement and governance that pulls 
them all together (figure 07). The 
next section looks at why these links 
break down; here the focus is on how 
they break down. 

First, children often arrive in 
school unprepared to learn—if they 
arrive at all. Malnutrition, illness, low parental 
investments, and the harsh environments associated 
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Figure O.7 Why learning doesn’t happen: 
Four immediate factors that break down 


Source: WDR 2018 team. 


with poverty undermine early childhood learning.*° 
Severe deprivations—whether in terms of nutri- 
tion, unhealthy environments, or lack of nurture by 
caregivers—have long-lasting effects because they 
impair infants’ brain development. Thirty percent 
of children under 5 in developing countries are 
physically stunted, meaning they have low height 
for their age, typically due to chronic malnutrition.” 
The poor developmental foundations and lower levels 
of preschool skills resulting from deprivation mean 
many children arrive at school unprepared to benefit 
fully from it (figure O.8).33 So even in a good school, 
deprived children learn less. Moreover, breaking 
out of lower learning trajectories becomes harder as 
these children age because the brain becomes less 
malleable. Thus education systems tend to amplify 
initial differences. Moreover, many disadvantaged 
youth are not in school. Fees and opportunity costs 
are still major financial barriers to schooling, and 
social dimensions of exclusion—for example, those 
associated with gender or disability—exacerbate the 
problem. These inequalities in school participation 
further widen gaps in learning outcomes. 
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Second, teachers often lack the skills or motiva- 
tion to be effective. Teachers are the most important 
factor affecting learning in schools. In the United 
States, students with great teachers advance 1.5 grade 
levels or more over a single school year, compared 
with just 0.5 grade levels for those with an ineffective 
teacher. In developing countries, teacher quality 
can matter even more than in wealthier countries.* 
But most education systems do not attract applicants 
with strong backgrounds. For example, 15-year-old 
students who aspire to be teachers score below the 
national average on PISA in nearly all countries. 
Beyond that, weak teacher education results in teach- 
ers lacking subject knowledge and pedagogical skills. 
In 14 Sub-Saharan countries, the average grade 6 
teacher performs no better on reading tests than do 
the highest-performing students from that grade.*” In 
Indonesia, 60 percent of the time in a typical mathe- 
matics class is spent on lecturing, with limited time 
remaining for practical work or problem-solving.*® 
Meanwhile, in many developing countries substantial 
amounts of learning time are lost because classroom 
time is spent on other activities or because teachers 
are absent. Only a third of total instructional time 
was used in Ethiopia, Ghana, and Guatemala.*? Across 
seven African countries, one in five teachers was 
absent from school on the day of an unannounced 
visit by survey teams, with another fifth absent 
from the classroom even though they were at school 
(figure O.9).4° The problems are even more severe in 
remote communities, amplifying the disadvantages 
already facing rural students. Such diagnostics are 
not intended to blame teachers. Rather, they call 
attention to how systems undermine learning by 
failing to support them. 

Third, inputs often fail to reach classrooms or to 
affect learning when they do. Public discourse often 
equates problems of education quality with input 
gaps. Devoting enough resources to education is cru- 
cial, and in some countries resources have not kept 
pace with the rapid jumps in enrollment. For several 
reasons, however, input shortages explain only a small 
part of the learning crisis. First, looking across systems 
and schools, similar levels of resources are often asso- 
ciated with vast differences in learning outcomes.” 
Second, increasing inputs in a given setting often has 
small effects on learning outcomes.” Part of the rea- 
son is that inputs often fail to make it to the front lines. 
A decade ago in Sierra Leone, for example, textbooks 
were distributed to schools, but follow-up inspec- 
tions found most of them locked away in cupboards, 
unused.* Similarly, many technological interventions 


Figure O.8 Socioeconomic gaps in cognitive achievement grow with age—even in preschool years 


Percentage of children ages 3-5 who can recognize 10 letters of the alohabet, by wealth quintile, selected countries 
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Source: WDR 2018 team, using data from Multiple Indicator Cluster Surveys (http://mics.unicef.org/). Data are for 2010 for the Central African Republic, 2010-11 for Kazakhstan, and 2012 


for Tunisia. Data at http://bit.do/WDR2018-Fig_0-8. 


fail before they reach classrooms, and even when they 
do make it to classrooms, they often do not enhance 
teaching or learning. In Brazil, a One Laptop Per Child 
initiative in several states faced years of delays. Then, 
even a year after the laptops finally made it to class- 
rooms, more than 40 percent of teachers reported 
never or rarely using them in classroom activities.** 
Fourth, poor management and governance often 
undermine schooling quality. Although effective 
school leadership does not raise student learning 
directly, it does so indirectly by improving teaching 
quality and ensuring effective use of resources.‘ 
Across eight countries that have been studied, a 1.00 
standard deviation increase in an index of manage- 
ment capacity—based on the adoption of 20 man- 
agement practices—is associated with a 0.23-0.43 
standard deviation increase in student outcomes. 
But school management capacity tends to be lowest 
in those countries with the lowest income levels, 
and management capacity is substantially lower in 
schools than in manufacturing (figure O.10).*° Inef- 
fective school leadership means school principals 
are not actively involved in helping teachers solve 
problems, do not provide instructional advice, and 
do not set goals that prioritize learning. School gover- 
nance—particularly the decision-making autonomy 
of schools, along with the oversight provided by 
parents and communities—serves as the framework 
for seeking local solutions and being accountable for 
them. In many settings, schools lack any meaningful 


Figure O.9 In Africa, teachers are often 
absent from school or from classrooms 
while at school 
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Note: “Absent from the classroom” combines absences from school with 
absences from class among teachers who are at school. Data are from the 
World Bank’s Service Delivery Indicators (SDI) surveys (http://www 
.worldbank.org/sdi). 


autonomy, and community engagement fails to affect 
what happens in classrooms.*” 

Because these quality problems are concentrated 
among disadvantaged children, they amplify social 
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Figure O.10 Management capacity 
is low in schools in low- and middle- 
income countries 
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indexes are constructed from the nine items that are comparable across 
sectors. Data on manufacturing are not available for Haiti. 


inequalities. In low-income countries, on average, 
stunting rates among children under 5 are almost 
three times higher in the poorest quintile than in 
the richest.4® In schools, problems with teacher 
absenteeism, lack of inputs, and weak management 
are typically severest in communities that serve the 
poorest students. It’s not just that spending patterns 
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typically disadvantage marginalized communities, 
but also that resources are used less effectively there, 
exacerbating the problem. Public policy thus has the 
effect of widening social gaps rather than offering all 
children an opportunity to learn. 


Systems are failing schools 

Viewed from a systems perspec- 
tive, the low level of learning and 
skills should come as no surprise. 
Technical complexities and polit- 
ical forces constantly pull edu- 
cation systems out of alignment 


ith | ing (fi 0.11). 
with learning (figure 0.11) Problem 


dimension 3: 


: Deeper causes 
Technical challenges: 


Reorienting toward learning is hard 

Complex systems and limited management capacity 
are obstacles to orienting all parts of an education 
system toward learning. First, the various parts of 
the system need to be aligned toward learning. But 
actors in the system have other goals—some stated, 
some not. Promoting learning is only one of these, 
and not necessarily the most important one. At times, 
these other goals can be harmful, such as when con- 
struction firms and bureaucrats collude to provide 
substandard school buildings for their financial gain. 
At other times, these goals may be laudable, such as 
nurturing shared national values. But if system ele- 
ments are aligned toward these other goals, they will 
sometimes be at cross-purposes with learning. 

Even when countries want to prioritize learning, 
they often lack the metrics to do so. Every system 
assesses student learning in some way, but many 
systems lack the reliable, timely assessments needed 
to provide feedback on innovations. For example, is 
a new teacher training program actually making 
teachers more effective? If the system lacks reliable 
information on the quality of teaching and the learn- 
ing of primary students—comparable across time or 
classrooms—there is no way to answer that question. 

To be truly aligned, parts of the education system 
also have to be coherent with one another. Imagine 
that a country has set student learning as a top prior- 
ity and that it has in place reasonable learning metrics. 
It still needs to leap a major technical hurdle, how- 
ever: ensuring that system elements work together. 
If a country adopts a new curriculum that increases 
emphasis on active learning and creative thinking, 
that alone will not change much. Teachers need to 
be trained so that they can use more active learning 


methods, and they need to care enough to make the 
change because teaching the new curriculum may 
be much more demanding than the old rote learning 
methods. Even if teachers are on board with curricu- 
lum reform, students could weaken its effects if an 
unreformed examination system creates misaligned 
incentives. In Korea, the high-stakes exam system 
for university entrance has weakened efforts to 
reorient secondary school learning. The curriculum 
has changed to build students’ creativity and socio- 
emotional skills, but many parents still send their chil- 
dren to private “cram schools” for test preparation.” 

The need for coherence makes it risky to borrow 
system elements from other countries. Education pol- 
icy makers and other experts often scrutinize systems 
that have better learning outcomes to identify what 
they could borrow. Indeed, in the 2000s the search for 
the secret behind Finland’s admirable record of learn- 
ing with equity led to a swarm of visiting delegations 
in what the Finns dubbed “PISA tourism.” Finland’s 
system gives considerable autonomy to its well- 
educated teachers, who can tailor their teaching to 
the needs of their students. But lower-performing 
systems that import Finland’s teacher autonomy 
into their own contexts are likely to be disappointed: 
if teachers are poorly educated, unmotivated, and 
loosely managed, giving them even more autonomy 
will likely make matters worse. South Africa discov- 
ered this in the 1990s and 2000s when it adopted a 
curriculum approach that set goals but left implemen- 
tation up to teachers.*° The approach failed because 
it proved to be a poor fit for the capacity of teachers 
and the resources at their disposal.*' Home-grown, 
context-specific solutions are important. 

Successful systems combine both alignment and 
coherence. Alignment means that learning is the goal 
of the various components of the system. Coherence 
means that the components reinforce each other in 
achieving whatever goals the system has set for them. 
When systems achieve both, they are much more likely 
to promote student learning. Too much misalignment 
or incoherence leads to failure to achieve learning, 
though the system might achieve other goals (table O.1). 


Political challenges: Key players don’t 
always want to prioritize student learning 
Political challenges compound technical ones. Many 
education actors have different interests, again 
beyond learning. Politicians act to preserve their 
positions in power, which may lead them to target 
particular groups (geographic, ethnic, or economic) 
for benefits. Bureaucrats may focus more on keeping 


Figure O.11 Technical and political factors divert 
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Source: WDR 2018 team. 


politicians and teachers happy than on promoting 
student learning, or they may simply try to protect 
their own positions. Some private suppliers of edu- 
cation services—whether textbooks, construction, or 
schooling—may, in the pursuit of profit, advocate pol- 
icy choices not in the interest of students. Teachers 
and other education professionals, even when moti- 
vated by a sense of mission, also may fight to main- 
tain secure employment and to protect their incomes. 
None of this is to say that education actors don't care 
about learning. Rather, especially in poorly managed 
systems, competing interests may loom larger than 
the learning-aligned interests (table 0.2). 

Misalignments aren't random. Because of these 
competing interests, the choice of a particular policy 
is rarely determined by whether it improves learning. 
More often, the choice is made by the more powerful 
actors in the policy arena. Agents are accountable to 
one another for different reasons, not just learning. 
Given these interests, it should come as no surprise 
that little learning often results. 

One problem is that activities to promote learning 
are difficult to manage. Teaching and learning in the 
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Table O.1 Alignment and coherence both matter 
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Table O.2 Multiple interests govern the actions of education stakeholders 


Examples of . . . 


Stakeholders Learning-aligned interests Competing interests 

Teachers Student learning, professional ethic Employment, job security, salary, private 
tuitions 

Principals Student learning, teacher performance Employment, salary, good relations with 
staff, favoritism 

Bureaucrats Well-functioning schools Employment, salary, rent-seeking 

Politicians Well-functioning schools Electoral gains, rent-seeking, patronage 


Parents and students 


Student learning, employment of 


Family employment, family income, 


graduates outdoing others 
Judiciary Meaningful right to education Favoritism, rent-seeking 
Employers Skilled graduates Low taxes, narrowly defined selfinterests 


Nongovernment schools (religious, 
nongovernmental, for-profit) 


Innovative, responsive schooling 


Profit, religious mission, funding 


Suppliers of educational inputs (e.g., 
textbooks, information technology, buildings) 


High-quality, relevant inputs 


Profit, influence 


International donors 


Student learning 


Domestic strategic interests, taxpayer 
support, employment 


Source: WDR 2018 team. 


classroom involve significant discretion by teachers, 
as well as regular and repeated interactions between 
students and teachers. These characteristics, cou- 
pled with a dearth of reliable information on learn- 
ing, make managing learning more difficult than 
pursuing other goals.53 For example, improvements 
in access to education can be monitored by looking 
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at simple, easily collected enrollment data. Similarly, 
school construction, cash transfer programs, teacher 
hiring, and school grant programs intended to 
expand access are all highly visible, easily monitored 
investments. 

The potential beneficiaries of better foundational 
learning—such as students, parents, and employers— 


often lack the organization, information, or short- 
term incentive to press for change. Parents are usually 
not organized to participate in debates at the system 
level, and they may lack knowledge of the potential 
gains from different policies to improve learning.** 
They also may worry about the potential ramifica- 
tions for their children or themselves of opposing 
interests such as teachers, bureaucrats, or politicians. 
Students have even less power—except sometimes in 
higher education, where they can threaten demon- 
strations—and, like parents, they may be unaware of 
how little they are learning until they start looking 
for work. Finally, the business community, even if it 
suffers from a shortage of skilled graduates to hire, 
often fails to advocate for quality education, instead 
lobbying for lower taxes and spending. By contrast 
to these potential beneficiaries of reform, the poten- 
tial losers tend to be more aware of what is at stake 
for them and, in many cases, better organized to act 
collectively. 

As a result, many systems are stuck in low- 
learning traps, characterized by low accountabil- 
ity and high inequality. These traps bind together 
key stakeholders through informal contracts that 
prioritize other goals such as civil service employ- 
ment, corporate profits, or reelection, perpetuating 
the low-accountability equilibrium. In better-run 
systems, actors such as bureaucrats and teachers 
can devote much of their energy to improving 
outcomes for students. But in low-learning traps 
those same actors lack either the incentives or the 
support needed to focus on learning. Instead, they 
are constantly pressured to deliver other services 
for more powerful players. As actors juggle multiple 
objectives, relying on each other in an environment 
of uncertainty, low social trust, and risk aversion, it 
is often in the interest of each to maintain the status 
quo—even if society, and many of these actors, would 
be better off if they could shift to a higher-quality 
equilibrium. 

This diagnosis has concentrated on the shortfalls 
in foundational learning, as will the priorities for 
action discussed in the next section. However, this 
focus should not be interpreted as a statement that 
other areas are unimportant. Education systems and 
their enabling environment are broader and more 
complex than this Report can cover, so our priority 
here is to highlight what can be done most immedi- 
ately to strengthen the foundations of learning on 
which all successful systems are built. But both the 
diagnosis and the priorities for action are relevant for 


other parts of the system, such as higher education or 
lifelong learning. In these areas, too, many countries 
suffer from a lack of attention to outcomes, wide gaps 
in opportunity, and systemic barriers to resolving 
these problems. 


Still, there are reasons for hope 

Even in countries that seem stuck in low-learning 
traps, some teachers and schools manage to strengthen 
learning. These examples may not be sustainable—and 
they are not likely to spread systemwide without 
efforts to reorient the system toward learning—but 
systems willing to learn from these outliers can bene- 
fit. On a larger scale, some regions within countries are 
more successful in promoting learning, as are some 
countries at each income level. 

These examples reveal that higher-level system 
equilibriums exist. But is it possible for a whole 
system to escape the low-learning trap, moving 
to a better one? There are at least two reasons for 
optimism. First, as countries innovate to improve 
learning, they can draw on more systematic knowl- 
edge than ever available before about what can work 
at the micro level—the level of learners, classrooms, 
and schools. A number of interventions, innovations, 
and approaches have resulted in substantial gains 
in learning. These promising approaches come in 
many flavors—new pedagogical methods, ways to 
ensure that students and teachers are motivated, 
approaches to school management, technologies to 
enhance teaching learning—and they may not pay 
off in all contexts, but the fact that it is possible to 
improve learning outcomes should give hope. These 
interventions can provide substantial improvements 
in learning: almost one or two grade-equivalents for 
some students. Even though successful interven- 
tions cannot be imported wholesale into new con- 
texts, countries can use them as starting points for 
their own innovations. 

Second, implemented 
reforms that have led to sustained systemwide 
improvements in learning. Finland’s major education 
reform in the 1970s famously improved the equity 
of outcomes while also increasing quality, so that by 
the time of the first PISA in 2000, Finland topped the 
assessment. More recently, Chile, Peru, Poland, and 
the United Kingdom have made serious, sustained 
commitments to reforming the quality of their 
education systems. In all these countries, learning 
has improved over time—not always steadily, but 
enough to show that system-level reforms can pay off. 


some countries have 
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The education systems in Shanghai (China) and 
Vietnam today—and Korea decades ago—show that 
it is possible to perform far better than income levels 
would predict, thanks to a sustained focus on learning 
with equity. Brazil and Indonesia have made consid- 
erable progress, despite the challenges of reforming 
large, decentralized systems. 


How to realize education’s 
promise: Three policy 
responses 


Learning outcomes won't change unless education 
systems take learning seriously and use learning as 
a guide and metric. This idea can be summarized as 
“all for learning.” As this section explains, a com- 
mitment to all for learning—and thus to learning for 
all—implies three complementary strategies: 


Assess learning—to make it a serious goal. Measure and 

track learning better; use the results to guide action. 

* Act on evidence—to make schools work for all learners. 
Use evidence to guide innovation and practice. 

* Align actors—to make the whole system work for learn- 

ing. Tackle the technical and political barriers to 

learning at scale. 


These three strategies depend on one another. 
Adopting a learning metric without any credible way 
to achieve learning goals will simply lead to frustra- 
tion. School-level innovations without a learning 
metric could take schools off course, and without the 
system-level support they could prove ephemeral. 
And system-level commitment to learning without 
school-level innovation, and without learning mea- 
sures to guide the reforms, is unlikely to amount to 
more than aspirational rhetoric. But together, the 
three strategies can create change for the better. 

The potential payoff is huge. When children havea 
growth mindset, meaning they understand their own 
great learning potential, they learn much more than 
when they believe they are constrained by a fixed 
intelligence.5’ Societies have the same opportunity. By 
adopting a social growth mindset—recognizing the 
barriers to learning, but also the very real opportu- 
nities to break them down—they can make progress 
on learning. One overarching priority should be to 
end the hidden exclusion of low learning. This is not 
just the right thing to do; it is also the surest way to 
improve average learning levels and reap education's 
full rewards for society as a whole. 


16 | World Development Report 2018 


Assess learning—to make it a serious goal 
“What gets measured gets man- 
aged.” “Just weighing the pig 
doesn’t make it fatter.” There is 
some truth to both of these say- O 
ings. Lack of measurement makes 
it hard to know where things are, 
where they are going, and what 


actions are making any difference. Policy 

Knowing these things can provide response 1: 

focus and stimulate action. But Assess 
learning 


measurement that is too removed 
from action can lead nowhere. The challenge is strik- 
ing a balance—finding the right measures for the 
right purposes and implementing them within an 
appropriate accountability framework. 


Use measurement to shine a light on 
learning 

The first step to improving systemwide learning is 
to put in place good metrics for monitoring whether 
programs and policies are delivering learning. Cred- 
ible, reliable information can shape the incentives 
facing politicians. Most notably, information on stu- 
dent learning and school performance—if presented 
in a way that makes it salient and acceptable—fosters 
healthier political engagement and better service 
delivery. Information also helps policy makers man- 
age a complex system. 

Measuring learning can improve equity by 
revealing hidden exclusions. As emphasized at the 
outset of this overview, the learning crisis is not just 
a problem for the society and economy overall; it is 
also a fundamental source of inequities and widening 
gaps in opportunity. But because reliable information 
on learning is so spotty in many education systems, 
especially in primary and lower secondary schools, 
the way the system is failing disadvantaged children 
is a hidden exclusion.®* Unlike exclusion from school, 
lack of learning is often invisible, making it impos- 
sible for families and communities to exercise their 
right to quality education. 

These measures of learning will never be the only 
guide for educational progress, nor should they be. 
Education systems should have ways of tracking 
progress toward any goal they set for themselves and 
their students—not just learning. Systems should also 
track the critical factors that drive learning—such as 
learner preparation, teacher skills, quality of school 
management, and the level and equity of financing. 
But learning metrics are an essential starting point 
for improving lagging systems. 


Figure O.12 Many countries lack information on learning outcomes 


Percentage of countries with data to monitor progress toward the Sustainable Development Goals for learning by the end of 


primary or lower secondary school 
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Source: UIS (2016). Data at http://bit.do/WDR2018-Fig_0O-12. 
Note: Regional groupings follow UNESCO definitions. 


There is too little measurement of learning, 
not too much 

A recommendation to start tackling the learning cri- 
sis with more and better measurement of learning 
may seem jarring. Many education debates highlight 
the risks of overtesting or an overemphasis on tests. 
In the United States, two decades of high-stakes test- 
ing have led to patterns of behavior consistent with 
these concerns.» Some teachers have been found to 
concentrate on test-specific skills instead of untested 
subjects, and some schools have engaged in strategic 
behavior to ensure that only the better-performing 
students are tested, such as assigning students to 
special education that excuses them from testing.® In 
the extreme, problems have expanded to convictions 
for systemic cheating at the school district level.® At 
the same time, media coverage of education in many 
low- and middle-income countries (and some high- 
income ones) often focuses on high-stakes national 
examinations that screen candidates for tertiary edu- 
cation—raising concerns about an overemphasis on 
testing. 

But in many systems the problem is too little 
focus on learning—not too much. Many countries 
lack information on even basic reading and math 
competencies. An assessment of capacity to monitor 


progress toward the United Nations’ Sustainable 
Development Goals found that of the 121 countries 
studied, a third lack the data required to report on 
the levels of reading and mathematics proficiency 
of children at the end of primary school.” Even 
more lack data for the end of lower secondary school 
(figure 0.12). Even when countries have these data, 
they are often from one-off assessments that do not 
allow systematic tracking over time. A lack of good 
measurement means that education systems are 
often flying blind—and without even agreement on 
the destination. 


Use a range of metrics with one ultimate 
goal 
Different learning metrics have different purposes, 
but each contributes to learning for all. Teachers 
assess students in classrooms every day—formally 
or informally—even in poorly resourced, poorly man- 
aged school systems. But using metrics properly to 
improve learning systemwide requires a spectrum of 
types of assessment that, together, allow educators 
and policy makers to use the right combination of 
teaching approaches, programs, and policies. 
Formative assessment by teachers helps guide 
instruction and tailor teaching to the needs of 
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students. Well-prepared, motivated teachers do not 
need to operate in the dark: they know how to assess 
the learning of students regularly, formally and 
informally. As the next section discusses, this type of 
regular check-in is important because many students 
lag so far behind that they effectively stop learning. 
Knowing where students are allows teachers to 
adjust their teaching accordingly and to give students 
learning opportunities they can handle. Singapore 
has successfully used this approach—identifying 
lagging students in grade 1 using screening tests and 
then giving them intensive support to bring them up 
to grade level.® 

National and subnational learning assessments 
provide system-level insights that classroom assess- 
ments by teachers cannot. To guide an education 
system, policy makers need to understand whether 
students are mastering the national curriculum, in 
which areas students are stronger or weaker, whether 
certain population groups are lagging behind and 
by how much, and which factors are associated with 
better student achievement. There is no effective way 
to aggregate the results of classroom-level formative 
assessment by teachers into this type of reliable 
system-level information. This is why systems need 
assessments of representative samples of students 
across wider jurisdictions, such as countries or prov- 
inces. Such assessments can be an especially import- 
ant part of tracking systemwide progress because 
they are anchored in a system’s own expectations for 
itself. And national assessments can provide a check 
on the quality of subnational assessments by flagging 
cases in which trends or levels of student achieve- 
ment diverge across the two. In the United States, 
the National Assessment of Educational Progress has 
played this role.%+ 

International assessments also provide informa- 
tion that helps improve systems. Globally bench- 
marked student assessments such as PISA, TIMSS, 
and PIRLS, as well as regionally benchmarked ones 
such as PASEC in West and Central Africa and the 
Latin American Laboratory for Assessment of the 
Quality of Education (LLECE), provide an additional 
perspective on how well students are learning. They 
allow assessment of country performance in a way 
that is comparable across countries, and they pro- 
vide a check on the information that emerges from 
national assessments. And international assessments 
can be powerful tools politically: because country 
leaders are concerned with national productivity and 
competitiveness, international benchmarking can 
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raise awareness of how a country is falling short of its 
peers in building human capital. 

Two other types of learning metrics measured 
in nonschool settings can be used to strengthen the 
quality and equity focus of assessment systems. 
Grassroots accountability movements—led by civil 
society organizations such as the ASER Centre in India 
and Uwezo in East Africa—have deployed citizen-led 
assessments that recruit volunteers to measure the 
foundational learning of young children in their 
communities. These organizations then use their 
learning data to advocate for education reform. Some 
multipurpose household surveys also collect learning 
data, enabling researchers to analyze how learning 
outcomes correlate with income and community 
variables. Both types of assessments are administered 
in people’s homes, not schools. As a result, they 
don’t suffer from a key weakness of school-based 
assessments: when marginal students drop out, their 
absence can improve the average scores on school 
assessments, thereby creating a perverse incentive 
for school leaders. But household-based assessments 
yield learning metrics that reward systems for 
improving both access and quality. This is crucial to 
ensuring that no child is written off. Even for students 
who are in school, household-based assessments pro- 
vide an alternative source of learning data, which can 
be important in settings where official assessments 
are of questionable quality. 


Measurement can be hard 

Why isn’t there more and better measurement of 
learning? As with system barriers to learning, bar- 
riers to better measurement are both technical and 
political. From a technical perspective, conducting 
good assessments is not easy. At the classroom 
level, teachers lack the training to assess learning 
effectively, especially when assessments try to cap- 
ture higher-order skills—say, through project-based 
assessment—rather than rote learning. And at the 
system level, education ministries lack the capacity 
to design valid assessments and implement them ina 
sample of schools. Political factors intrude as well. To 
paraphrase an old saying, policy makers may decide 
it is better to avoid testing and be assumed inef- 
fective than to test students and remove all doubt. 
And even when they do participate in assessments, 
governments sometimes decline to release the learn- 
ing results to the public, as happened with the 1995 
TIMSS in Mexico.® Finally, if assessments are poorly 
designed or inappropriately made into high-stakes 


tests, administrators or educators may have an 
incentive to cheat on them, rendering the assessment 
results worthless as a guide to policy. 


Measurement doesn’t need to detract from 
broader education objectives—it can even 
support them 

A stronger emphasis on measurable learning 
doesn’t mean that other education outcomes don't 
matter. Formal education and other opportunities 
for learning have many goals, only some of which 
are captured by the usual assessments of literacy, 
numeracy, and reasoning. Educators also aspire to 
help learners develop higher-order cognitive skills, 
including some (like creativity) that are hard to 
capture through assessments. Success in life also 
depends on socioemotional and noncognitive skills— 
such as persistence, resilience, and teamwork—that a 
good education helps individuals develop. Education 
systems often have other goals as well: they want to 
endow students with citizenship skills, encourage 
civic-minded values, and promote social cohesion. 
These are widely shared goals of education, and it is 
understandable that people will ask whether, espe- 
cially in education systems that are already over- 
burdened, increasing the emphasis on measurable 
learning will crowd out these other goals. 

In fact, a focus on learning—and on the educa- 
tional quality that drives it—is more likely to “crowd 
in” these other desirable outcomes. Conditions that 
allow children to spend two or three years in school 
without learning to read a single word, or to reach 
the end of primary school without learning to do 
two-digit subtraction, are not conducive to reaching 
the higher goals of education. Schools that cannot 
equip youth with relevant job skills usually will not 
prepare them to launch new companies or analyze 
great works of literature either. If students cannot 
focus because of deprivation, if teachers lack the 
pedagogical skills and motivation to engage students, 
if materials meant for the classroom never reach it 
because of poor management, and if the system as a 
whole is unmoored from the needs of society—well, is 
it really plausible to believe that students are develop- 
ing higher-order thinking skills like problem-solving 
and creativity? It is more likely that these conditions 
undermine the quest for higher goals—and that, con- 
versely, improving the learning focus would acceler- 
ate progress toward those goals as well. 

Paradoxically, lower-performing countries proba- 
bly do not face the same sharp trade-offs encountered 


Figure O.13 Low-performing countries don’t 
face sharp trade-offs between learning and 
other education outputs 
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by high-performing countries on the education 
frontier. Economists use the concept of the produc- 
tion possibilities frontier to understand how pro- 
ducers—or in this case countries—make trade-offs 
between the production of different goods. This 
idea encapsulates the debates on education policy 
in OECD countries on the learning frontier (figure 
0.13). For example, in recent years many stakehold- 
ers in Korea have argued that their high-performing 
education system places too much emphasis on test 
scores (called “measured learning” in figure 0.13) and 
not enough on creativity and certain socioemotional 
skills such as teamwork (“other outputs”). Implicitly, 
this Korean debate is about whether to try to move 
up and to the left on the frontier—that is, from A 
toward B. But in the low-learning trap, represented 
by “low-performing country C” in the figure, there is 
so much slack and such a weak focus on outcomes 
that this OECD-driven debate is not relevant. Coun- 
try C has an opportunity to improve on both mea- 
sured learning and other education outputs at the 
same time. An experiment in Andhra Pradesh, India, 
that rewarded teachers for gains in measured learn- 
ing in math and language led to more learning not 
just in those subjects, but also in science and social 
studies—even though there were no rewards for 
the latter.°° This outcome makes sense—after all, lit- 
eracy and numeracy are gateways to education more 
generally. 
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Act on evidence—to make schools work for 
all learners 


(CY 
rd 


Measurement of learning shortfalls 
doesn't provide clear guidance on 
how to remedy them. Fortunately, 
there is now a lot of experience 
on ways to improve learning out- 
comes at the student, classroom, 
and school levels. Cognitive neuro- 


Policy science has evolved dramatically 
bia bs 2: in the last two decades, providing 

dee insights on how children learn.‘ 
evidence 


This work has revealed how import- 
ant the first several years of life are to a child’s brain 
development.® At the same time, schools and systems 
around the world have innovated in many ways: by 
deploying novel approaches to pedagogy, using new 
technologies to enhance teaching and learning in 
classrooms, or increasing the accountability, and some- 
times autonomy, of various actors in the system. The 
number of systematic evaluations of whether these 
interventions have improved learning has increased 
more than 10-fold, from just 19 in 2000 to 299 in 2016. 

Many interventions have succeeded in improving 
learning outcomes. The learning gains from effec- 
tive interventions translate into additional years of 
schooling, higher earnings, and lower poverty. For a 
group of stunted Jamaican children 9-24 months old, 
a program to improve cognitive and socioemotional 
development led to much better outcomes 20 years 
later—lower crime rates, better mental health, and 
earnings that were 25 percent higher than those of 
nonparticipants.” Programs to improve pedagogy 
have had an impact greater than the equivalent of an 
extra half a year of business-as-usual schooling and 
an 8 percent increase in the present discounted value 
of lifetime earnings.” So while tackling the learning 
crisis is hard, the fact that there are interventions that 
improve learning suggests ways forward. 

This evidence base does not allow us to identify 
what works in all contexts because there are no 
global solutions in education. Improving learning in 
a particular setting will never be as simple as taking 
a successful program from one country or region and 
implementing it elsewhere. Randomized controlled 
trials and other approaches to evaluate impact place 
a premium on carefully isolating the causal impact 
of an intervention. But such approaches may ignore 
important interactions with underlying factors that 
affect whether an intervention makes a difference— 
factors that may not be at play when replicating the 
intervention in a new context. For example, increas- 
ing class size by 10 students reduced test scores by 
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four times as much in Israel as it did in Kenya—and it 
has had no impact in some contexts.” In the words of 
two commentators on this literature: “Knowing ‘what 
works’ in the sense of the treatment effect on the trial 
population is of limited value without understanding 
the political and institutional environment in which 
it is set.”73 

The next section tackles the question of that 
broader environment, but in the meantime we first 
address how to use this evidence most effectively. 
There are four main considerations. 

First, more important than the individual results 
from individual studies are the principles of how 
and why programs work. In economic terms, “princi- 
ples” correspond to models of behavior that can then 
help guide broader sets of approaches to addressing 
problems. Three types of models can prove especially 
insightful: straightforward models in which actors 
maximize their welfare subject to the constraints 
they face; principal-agent models that incorporate 
multiple actors with different goals and perhaps dif- 
ferent information; and behavioral models that factor 
in mental models and social norms. 

Second, a gap between what the evidence suggests 
may be effective and what is done in practice points 
to a potential entry point for action. Understanding 
why gaps open up helps guide how to address them. 
For example, when different actors face different 
information, or some actors lack information, this 
suggests drawing from approaches that show how 
information can be disseminated and used better. 
Gaps point to which types of principles should drive 
context-specific innovation. 

Third, evidence tends to accumulate where it 
is easiest to generate, not necessarily where action 
would make the most difference, so policies focused 
only on that evidence might be misguided.” Though 
the scope of the accumulated evidence in education is 
broad, just because an approach hasn't been evaluated 
doesn’t mean it lacks potential. Context-specific inno- 
vation may mean trying things that have not been 
tried elsewhere. 

Fourth, a focus on underlying principles high- 
lights that the problem can't be solved by one decision 
maker simply prescribing an increase in the quantity, 
or even the quality, of one or more inputs. Many of 
the inputs in learning are the result of choices made 
by the various actors—choices made in reaction to 
the actual and anticipated choices of other actors. 
For example, teachers respond to incentives to attend 
school and to improve student outcomes, even 
though the nature of the response varies across con- 
texts.” Likewise, students and parents make choices 


Figure O.14 It’s more complicated than it looks: People act in reaction to the 


choices of others throughout the system 
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responding to other decisions. In India and Zambia, 
government grants to schools led parents to reduce 
their own investments in their children’s schooling.” 
All things considered, a more complete character- 
ization of the learning framework might be closer 
to the one illustrated in figure 0.14: learning how 
to improve outcomes by intervening at the student, 
classroom, and school levels involves illuminating the 
various arrows. 

Putting all this together sheds light on three sets 
of promising entry points: prepared learners, effec- 
tive teaching, and school-level interventions that 
actually affect the teaching and learning process. 
Each of these priority areas is founded on evidence 
from multiple contexts showing that it can make a 
real difference for learning. 


Prepare children and youth for learning 

Getting learners to school ready and motivated to 
learn is a first step to better learning. Without it, other 
policies and programs will have a minimal effect. 


There are three key entry points to addressing learner 
preparation: 


* Set children on high-development trajectories through 
early childhood nutrition, stimulation, and care. Three 
approaches stand out from successful experiences. 
First, target mothers and their babies with health 
and nutrition interventions during the first 1,000 
days to reduce malnutrition and foster physiolog- 
ical development. Second, increase the frequency 
and quality of stimulation and opportunities for 
learning at home (starting from birth) to improve 
language and motor development, as well as to 
cultivate early cognitive and socioemotional skills. 
Third, promote day-care centers for very young 
children and preschool programs for children 
3-6 years old—along with caregiver programs that 
enhance the nurturing and protection of children— 
to improve cognitive and socioemotional skills in 
the short run, as well as education and labor market 
outcomes later in life.” Program quality matters 
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a lot: center-based programs with poor process 
quality (even with relatively good infrastructure, 
caregiver training, and caregiver-children ratios) 
can actually worsen developmental outcomes.” 

Lower the cost of schooling to get children into school, but 
then use other tools to boost motivation and effort because 
cost-reducing interventions don't usually lead to learning 
on their own.” To improve learning, demand-side pro- 
grams need to increase a student's effort or capacity 
to learn. School-provided meals, for example, have 
had positive effects on access—and also on learning 
in places where children have limited access to food 
at home.® Targeted cash transfers have led to more 
learning when they have incentivized performance 
itself* or were marketed in a way that induces more 
effort, such as in Cambodia.*? Some information 


interventions have motivated efforts as well. 

To make up for the fact that so many youth lack skills 
when leaving basic education, provide remediation before 
further education and training.** Remediation in school 
is a first best approach. After school, the more suc- 
cessful programs share two main features. First, 
they provide bridging courses in real-life settings, 
which allows learners with very low foundational 
skills to build these in the workplace.* Second, accel- 
erated, flexible pathways—not sequential courses 
over multiple semesters—are associated with greater 
student retention and ultimate certification.® 


Make teaching more effective 

Effective teaching depends on teachers’ skills and 
motivation, and yet many systems do not take 
them seriously. Teacher salaries are the largest 
single budget item in education systems, consuming 
three-quarters of the budget at the primary level in 
developing countries. Yet many systems struggle 
to attract strong candidates into teaching and to 
provide a solid foundation of subject or pedagogical 
knowledge before they start teaching. As a result, new 
teachers often find themselves in classrooms with 
little mastery of the content they are to teach.*” Once 
teachers are in place, the professional development 
they receive is often inconsistent and overly theo- 
retical. In some countries, the cost of this training is 
enormous, reaching $2.5 billion a year in the United 
States.*® Moreover, education systems often have few 
effective mechanisms in place to mentor, support, 
and motivate teachers—even though teachers’ skills 
do nothing for learning unless teachers choose to 
apply them in the classroom. Fortunately, teachers’ 
skills and motivation can be strengthened, leading 
to greater effort and more learning, with three main 
promising principles emerging: 
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* For effective teacher training, design it to be individually 
targeted and repeated, with follow-up coaching—often 
around a specific pedagogical technique. This approach 
contrasts starkly with much of today’s profes- 
sional development for teachers across a range of 
countries. In the United States, a team of teacher 
training experts characterized professional devel- 
opment there as “episodic, myopic, and often mean- 
ingless.”*° In Sub-Saharan Africa, teacher training is 
often too short to be effective and too low in quality 
to make a difference." By contrast, programs in 
Africa and South Asia that provided long-term 
coaching led to sizable learning gains.” 

To keep learners from falling behind to the point where 
they cannot catch up, target teaching to the level of the 
student. Over the course of several grades, often 
only a fraction of learners progress at grade level, 
with most falling behind and some learning almost 
nothing. This is partly because teachers teach to the 
most advanced students in the class, as documented 
from Australia to Sweden to the United States,” or 


e 


because the curriculum is too ambitious but teach- 
ers are required to teach it.% Effective strategies to 
target teaching to the level of the student include 
using community teachers to provide remedial les- 
sons to the lowest performers, reorganizing classes 
by ability, or using technology to adapt lessons to 
individual student needs. 

Use pecuniary and nonpecuniary incentives to improve 
the motivation of teachers, ensuring that the incentiv- 
ized actions are within teachers’ capacity. Education 
systems typically neither reward teachers for per- 
forming well nor penalize them for performing 
poorly. Incentives are most likely to be effective 
at improving outcomes when there are straight- 
forward actions that teachers can take to improve 
learning—such as increasing attendance when 
absenteeism is the constraint. But incentives do not 
need to be high stakes (or financial) to affect behav- 
ior. In Mexico and Punjab, Pakistan, simply provid- 
ing diagnostic information to parents and schools 
about the schools’ relative performance improved 
learning outcomes.” 


Focus everything else on teaching and 
learning 

School inputs, management, and governance must 
benefit the learner-teacher relationship if they are 
to improve learning—but many do not. Debates on 
improving education outcomes frequently revolve 
around increasing inputs, such as textbooks, technol- 
ogy, or school infrastructure. But too often the question 
of why these inputs might actually improve learning is 


overlooked. The evidence on successful use of inputs 
and management suggests three main principles: 


* Provide additional inputs, including new technologies, 
in ways that complement rather than substitute for 
teachers.” A computer-assisted learning program 
in Gujarat, India, improved learning when it added 
to teaching and learning time, especially for the 
poorest-performing students. A Kenyan program 
that provided public school teachers with tablets 
to support instruction increased the reading per- 
formance of their students.” But simply providing 
desktop computers to classrooms in Colombia— 
where they were not well integrated with the cur- 
riculum—had no impact on learning." Even more 
traditional inputs—such as books—often fail to 
affect teaching and learning when they aren't actu- 
ally deployed in classrooms, or if the content is too 
advanced for the students. 

Ensure that new information and communication tech- 
nology is really implementable in the current systems. 
Interventions that incorporate information and 
communication technology have some of the big- 
gest impacts on learning.” But for every highly 
effective program—such as a dynamic computer- 
assisted learning program for secondary school 
students in Delhi that increased math and language 
scores more than the vast majority of other learning 
interventions tested in India or elsewhere’?—there 
are programs such as the One Laptop Per Child pro- 
grams in Peru and Uruguay, which evaluations sug- 
gested had no impact on student reading or math 
ability.°* Technologies ill-adapted to their settings 
often fail to reach the classroom or to be used if they 
reach it.’ 

Focus school management and governance reforms 
on improving teacher-learner interaction. Training 
principals in how to improve that interaction—by 
providing feedback to teachers on lesson plans, 
action plans to improve student performance, 
and classroom behavior—has led to a large impact 
on student learning.’ In countries ranging from 
Brazil and India to Sweden, the United Kingdom, 
and the United States, the management capacity of 
school principals significantly and robustly relates 
to student performance—even after controlling for 
a variety of student and school characteristics.’” 
Involving communities, parents, and school actors 
in ways that promote local oversight and account- 
ability for service delivery can improve outcomes.’ 
But community monitoring tends to have more 
impact when it covers things that parents can 
easily observe (such as teacher absenteeism when 


it is high), and when a range of stakeholders (not 
just parents) are brought together in ways that lead 
to action. In Indonesia, school grants improved 
learning when links between the school and the 
village council—a center of local authority—were 
strengthened. 


The most effective systems—in terms of learn- 
ing—are those that have narrowed gaps between 
evidence and practice. On learner preparation, for 
example, East Asian countries such as Korea and Sin- 
gapore have achieved high levels of children ready to 
learn. Stunting rates among preschool-age children 
are low, and children are motivated and supported by 
their families. To promote effective teaching, Finland 
and Singapore attract some of the most highly skilled 
graduates from tertiary education into teaching and 
provide them with effective professional develop- 
ment opportunities and sustained support. 


Align actors—to make the whole system 
work for learning 

Working at scale is not just “scaling 
up.” The concept of scaling up in 
education implies taking interven- 
tions that have been shown to be 
effective on a pilot or experimental 
scale and replicating them across 
hundreds or thousands of schools. 
However, this approach often fails 
because the key actors are human 
beings, operating with human 
aspirations and limitations in a 
politically charged arena. Real-world complications 
can undermine well-designed programs, especially 
when new, systemwide forces come into play. When 
the Cambodian government tried to scale up early 
child development centers and preschools— programs 
that had worked in some parts of the country when 
implemented by nongovernmental organizations 
(NGOs)—low demand from parents and low-quality 
services led to no impacts on child development, 
and even slowed it for some."° When the Kenyan 
government tried to lower student-teacher ratios by 
hiring contract teachers—an intervention that had 
improved student outcomes when implemented by 
an NGO—the results were negligible because of both 
implementation constraints and political economy 
factors." And when the Indonesian government 
tried to increase teacher capacity by nearly doubling 
the salaries of certified teachers, political pressures 
watered down the certification process and left only 
the pay increase in place. The result was much larger 
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budget outlays on salaries, but no increase in teach- 
ers’ skills or student learning.” 

The lesson, then, is that better interventions at the 
school and student levels will sustainably improve 
learning only if countries tackle the stubborn system- 
level technical and political barriers to change. Tech- 
nical barriers include the complexity of the system, 
the large number of actors, the interdependence of 
reforms, and the slow pace of change in education 
systems. Political barriers include the competing 
interests of different players and the difficulty of 
moving out of a low-quality equilibrium, especially 
in low-trust environments where risks predominate. 
All of these barriers pull actors away from learning, 
as discussed earlier. Systems that surmount these 
barriers and align actors toward learning can achieve 
remarkable learning outcomes. Shanghai provided 
proof when it topped the 2012 PISA rankings, in part 
thanks to policies that ensured that every classroom 
had a prepared, supported, and motivated teacher.” 

To shift the system toward learning, technically 
and politically, reformers can use three sets of tools: 


* Information and metrics. Better information and 
metrics can promote learning in two ways: by 
catalyzing reforms and by serving as indicators of 
whether reforms are working to improve learning 
with equity. Thus they can improve both the politi- 
cal and technical alignment of the system. 

* Coalitions and incentives. Good information will have 
a payoff only if there is enough support for prior- 
itizing learning. Politics is often the problem, and 
politics must be part of the solution. This requires 
forming coalitions to advocate for broad-based 
learning and skills and to rebalance the political 
incentives. 
Innovation and agility. Schools and societies have 
achieved high levels of equitable learning in a 
variety of ways. Figuring out what approaches will 
work in a given context requires innovation and 
adaptation. This means using evidence to identify 
where to start and then using metrics to iterate 
with feedback loops. 


All of these tools will be most effective when sup- 
ported by strong implementation capacity within 
government. 


Information and metrics 

Better information and measurement—starting with 
learning metrics—are critical to creating political 
space for innovation and then using that space to 
achieve continuous improvement. As emphasized, 
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the absence of good information on learning prevents 
stakeholders from judging system performance, 
designing the appropriate policies, and holding poli- 
ticians and bureaucrats to account. Thus improving 
learning metrics is crucial for drawing attention to 
problems and building the will for action. In Tanzania 
in the early 2010s, poor results on school-leaving exam- 
inations—along with well-publicized results from 
citizen-led learning assessments and surveys showing 
poor service delivery in schools—motivated policy 
makers to launch ambitious reforms. In Germany, the 
shock of mediocre results on the first PISA in 2000 led 
to reforms that improved both learning and equity. 

Efforts in this area need to go beyond just measur- 
ing learning; they should track its determinants as 
well. Understanding these determinants can enable 
reforms to grapple with the deeper causes, if there 
is a systemwide commitment to improving learning. 
Take the issue of learner preparedness. When indica- 
tors reveal that poorer children already lag far behind 
by the time they start primary school, this finding 
can build political will not only to expand preschool 
education in low-income areas, but also to combat 
stunting and educate parents about early stimulation 
of children. When indicators show that many teach- 
ers lack a strong command of what their students 
are meant to learn, this finding can spark efforts to 
improve the quality of teacher education.™ 

Of course, information and metrics can also be 
misleading, irrelevant, or politically unsustainable, 
so they need to be designed and used wisely. Metrics 
may fail to capture important dimensions of the 
outcomes the education system is trying to promote. 
For example, the Millennium Development Goal of 
universal primary education by 2015 embodied a cru- 
cial goal—equitable access—but it did not represent 
what many assumed it did: universal acquisition of 
foundational literacy and numeracy, let alone other 
life skills. Another risk is of distorting good metrics 
by putting high stakes on them, if potential benefi- 
ciaries can game the indicators. Thus systems will 
need different measures for different purposes.” 
Even if they are technically sound, metrics may 
prove politically unsustainable if they highlight too 
many problems and do not provide any reason for 
hope. One way to address this problem is to focus not 
on levels of learning, which may be very low, but on 
progress over time. 


Coalitions and incentives 

Mobilizing everyone who has a stake in learning 
has been an important strategy in efforts to improve 
learning. Many countries have used wide-ranging 


consultations that have tried to bring in all interest 
groups to build support for proposed changes in edu- 
cation policy. Malaysia used a “lab” model to bring 
together coalitions of stakeholders and involve them 
in all stages of reform, from design to implementa- 
tion."® Mobilizing citizens through regular informa- 
tion and communication campaigns can also be an 
important strategy. In Peru, reformers in the govern- 
ment used information on poor learning outcomes 
and performance of the education system to mobilize 
public support for reforms to strengthen teacher 
accountability. That information also catalyzed action 
by the business community, which funded a cam- 
paign highlighting the importance of quality educa- 
tion for economic growth. In parts of Peru, parents 
used this entry point to protest teacher strikes that 
had disrupted schooling.”” Another tool for building 
coalitions is to bundle reforms, so that each actor 
achieves one of its top priorities. For example, a com- 
mitment to modernize vocational training—a reform 
that could help employers immediately—could buy 
their support for broader education reforms. 

Where feasible, a negotiated and gradual approach 
to reform can provide a more promising alternative 
to direct confrontation. When system actors agree to 
collaborate and build trust around shared goals, the 
chances of successful reform are likely to be higher. 
In Chile, successive negotiations between the govern- 
ment and the teachers’ union built broad support fora 
series of reforms that adjusted the working conditions 
of teachers to improve their overall welfare, while 
linking pay and career development more closely to 
performance."® One approach used by several coun- 
tries has been to compensate actors who might lose 
out from reforms. In other cases, dual-track reforms 
have been introduced to phase in changes in a way 
that protects incumbent actors from their effects —for 
example, in Peru and the District of Columbia in the 
United States, pay-for-performance schemes were 
initially voluntary.” 

Building strong partnerships between schools and 
their communities is also important for sustaining 
reforms. Where political and bureaucratic incen- 
tives for reform are weak, action at the local level 
can act as a substitute. In South Africa, the political 
and economic context constrains efforts to improve 
education performance. Yet progress was made in 
improving outcomes at the local level through strong 
partnerships between parents and schools.”° Even 
where broader incentives exist to improve learning, 
community engagement at the local level is import- 
ant and can complement national or subnational 
change efforts.” 


Innovation and agility 
To develop effective learning approaches that fit their 
contexts, education systems need to encourage inno- 
vation and adaptation. In many education systems, 
schools and other education institutions regularly 
adapt to changing circumstances. Through these 
adaptations, innovative solutions to education chal- 
lenges often emerge. Exploring the well-performing 
parts of any education system can reveal technically 
and politically feasible approaches to the problems 
systems face in improving learning. For example, in 
Misiones province in Argentina high student dropout 
rates were widespread, but some schools seemed to 
buck the trend. A closer look at these “positive devi- 
ants” revealed very different relationships between 
teachers and parents. When other schools adopted 
the more constructive approach to parent-teacher 
relations used by the successful schools, their drop- 
out rates fell significantly."* Burundi, while recover- 
ing from a civil war, used an adaptive approach to find 
the right way to get textbooks to schools. It reduced 
delivery times from over a year to 60 days—then rep- 
licated that approach in other areas.”3 

Incentives are important in determining whether 
systems innovate and adopt emerging solutions at 
scale. Systems that are closed, that limit the autonomy 
of teachers and schools, and that judge performance by 
the extent of compliance with rules governing resource 
use often provide little room for innovation. By contrast, 
more open systems that pay more attention to overall 
outcomes and reward progress in raising outcomes are 
more likely to see greater innovation and the diffusion 
of new approaches across the education system.”4 

To make a difference at the system level, such 
innovations needs to be packaged with good metrics 
and with system-level coalitions for learning. With- 
out both, any improvements from innovation are 
likely to prove short-lived or limited to local areas. But 
with such support, a virtuous cycle becomes possible 
as systems follow these steps: 


Set learning as a clearly articulated goal and mea- 
sure it. 

Build a coalition for learning that gives the political 
space for innovation and experimentation. 
Innovate and test approaches that seem the most 
promising for the given context, drawing inspira- 
tion from the evidence base and focusing on areas 
that promise the biggest improvements over cur- 
rent practice. 

Use the measure of learning, along with the other 
metrics of delivery, as a gauge of whether the 
approach is working. 
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Figure O.15 Coherence and alignment toward learning 


Source: WDR 2018 team. 


* Build on what works, and scale back what doesn't, 
to deliver short-term results that strengthen the 
long-term resolve of the coalition for learning. 

* Repeat. 


The payoff to doing what needs to be done is a 
system in which the elements are coherent with each 
other and everything aligns with learning (figure 0.15). 

Increased financing can support this learning- 
for-all equilibrium, if the various key actors behave 
in ways that show learning matters to them. This is 
a big “if” because higher levels of public spending are 
not associated statistically with higher completion or 
even enrollment rates in countries with weak gover- 
nance.”5 Ensuring that students learn is even more 
challenging, and so there is little correlation between 
spending and learning after accounting for national 
income. It is easy to see the reason for this because 
of the many ways in which financing can leak out— 
whether because money never reaches the school, 
or because it pays for inputs that don’t affect the 
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teaching-learning relationship, or because the system 
doesn't prioritize learning for disadvantaged children 
and youth. More financing for business as usual will 
therefore just lead to the usual outcomes. But where 
countries seriously tackle the barriers to learning for 
all, spending on education is a critical investment for 
development, especially for those countries where 
overall spending is currently low, as recent major 
studies of global education have emphasized.”* More 
children staying in school longer and learning while 
there will undoubtedly require more public financing 
for education. An injection of financing—either from 
domestic or international sources—can help coun- 
tries escape the low-learning trap, if they are willing 
to take the other necessary steps laid out here. 


Implications for external actors 

External actors can reinforce these strategies for 
opening the political and technical space for learn- 
ing. In the realm of information and metrics, for 
example, international actors can fund participation 


in regional learning assessments (such as PASEC 
in West Africa or LLECE in Latin America) or global 
learning assessments (such as PISA or TIMSS) to 
spotlight challenges and catalyze domestic efforts 
for reform. External actors can also develop tools 
for tracking the proximate determinants of learning 
to aid in feedback loops. Domestic financing usu- 
ally makes up the bulk of education financing, so a 
high-leverage entry point for international actors is 
to fund better information that will make domestic 
spending more effective. In the realm of innovation 
and experimentation, external funders such as the 
World Bank can provide results-based financing that 
gives countries more room to innovate and iterate 
their way to achieving better outcomes. 


Learning to realize 
education’s promise 


By showing that learning really matters to them, 
countries can realize education's full promise. Beyond 
being a basic human right, education—done right— 
improves social outcomes in many spheres of life. 
For individuals and families, education boosts human 
capital, improves economic opportunities, promotes 
health, and expands the ability to make effective 
choices. For societies, education expands economic 
opportunities, promotes social mobility, and makes 
institutions function more effectively. In measuring 
these benefits, research has only recently focused on 
the distinction between schooling and learning. But 
the evidence confirms the intuition that these benefits 
often depend on the skills that students acquire, not 
just the number of years in the classroom. Economies 
with higher skills grow faster than those with school- 
ing but mediocre skills; higher literacy predicts better 
financial knowledge and better health, beyond the 
effects of schooling; and poor children are more likely 
to rise in the income distribution when they grow up 
in communities with better learning outcomes. 

Taking learning seriously won't be easy. It’s hard 
enough to work through the technical challenges of 
figuring out what will promote learning at the level of 
the student and school in any context, let alone tackle 
the political and technical challenges of working at 
scale. Many countries struggling with the learning 
crisis may be tempted to continue with business as 
usual. After all, they may reason, development will 
eventually improve learning outcomes: as households 
escape poverty and schools take advantage of better 
facilities, more materials, and better-trained teachers, 
better learning outcomes should follow. 


But waiting out the learning crisis isn’t a winning 
strategy. Even though national income and learning 
are somewhat correlated at lower levels of develop- 
ment, higher incomes do not invariably lead to better 
learning outcomes. And to the extent that develop- 
ment does bring better learning and skills, it is partly 
because development has been accompanied by a 
willingness to tackle the political impasses and gov- 
ernance challenges that hamper learning. Ultimately, 
then, those challenges are not avoidable. Furthermore, 
there's no need to wait for learning. At every level of 
income, there are countries that not only score better 
than others on international assessments, but also— 
and more important—show from the quality of their 
education systems and their policy making that they 
are committed to learning. 

The future of work will place a premium on learn- 
ing. Rapid technological change has led to major 
shifts in the nature of work, leading some to declare 
this anew era—the Second Machine Age or the Fourth 
Industrial Revolution. In the extreme versions of this 
vision, all but a few jobs could disappear, decreasing 
the value of skills for most people. But the seismic 
changes predicted have yet to permeate the high- 
income countries, let alone the low- and middle- 
income ones. More important, no matter how the 
demand for skills changes in the future, people 
will require a solid foundation of basic skills and 
knowledge. If anything, rapid change will increase 
the returns to learning how to learn, which requires 
foundational skills that allow individuals to size 
up new situations, adapt their thinking, and know 
where to go for information and how to make sense 
of it. 


RR 


Countries have already made a tremendous start by 
getting so many children and youth into school. Now 
it’s time to realize education's promise by accelerat- 
ing learning. A real education—one that encourages 
learning—is a tool for promoting both shared pros- 
perity and poverty elimination. That type of educa- 
tion will benefit many: children and families whose 
positive schooling experience restores their faith in 
government and society rather than eroding it; youth 
who have skills employers are seeking; teachers who 
can respond to their professional calling rather than 
to political demands; adult workers who have learned 
how to learn, preparing them for unforeseeable eco- 
nomic and social changes; and citizens who have the 
values and reasoning abilities to contribute to civic 
life and social cohesion. 
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Schooling, learning, and 
the promise of education 


“No one has yet realized the wealth of sympathy, the kindness and generosity 
hidden in the soul of a child. The effort of every true education should be to 


unlock that treasure.” 


EMMA GOLDMAN 


“In the long run, the best way to reduce inequalities with respect to labor as well as 
to increase the average productivity of the labor force and the overall growth of 
the economy is surely to invest in education.” 


THOMAS PIKETTY, CAPITAL IN THE TWENTY-FIRST CENTURY 


Education is a basic human right, and it is central to 
unlocking human capabilities. It also has tremendous 
instrumental value. Education raises human capital, 
productivity, incomes, employability, and economic 
growth. But its benefits go far beyond these mon- 
etary gains: education also makes people healthier 
and gives them more control over their lives. And it 
generates trust, boosts social capital, and creates insti- 
tutions that promote inclusion and shared prosperity. 


Education as freedom 


Since 1948, education has been recognized as a basic 
human right, highlighting its role as a safeguard for 
human dignity and a foundation of freedom, justice, 
and peace.' In the language of Amartya Sen’s capabil- 
ity approach, education increases both an individual's 
assets and his or her ability to transform them into 
well-being—or what has been called the individual's 
“beings and doings” and “capabilities.”” Education can 
have corresponding salutary effects on communities 
and societies. 

Education expands through many 
channels, both raising aspirations and increasing 


freedom 
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the potential to reach them. These benefits are both 
monetary and nonmonetary for individuals, families, 
communities, and society as a whole (table 1.1). 

Most people—whether policy makers or parents— 
already recognize the great value of education 
Families around the world make great sacrifices to 
keep their children in good schools, and political and 
opinion leaders consistently rank education among 
their top development priorities. For that reason, this 
chapter does not try to review all the evidence on the 
benefits of education. But before launching into the 
main theme of this Report—the learning crisis and 
what to do about it—it is worth surveying briefly 
the many ways in which education can contribute 
to progress, highlighting that these benefits often 
depend on learning, not just schooling.4 


Education improves 
individual freedoms 


Education improves economic opportunities 
Education is a powerful tool for raising incomes. 
Education makes workers more productive by giving 


Table 1.1 Examples of education’s benefits 


Individual/family 


Community/society 


Monetary Higher probability of employment 
Greater productivity 
Higher earnings 


Reduced poverty 


Higher productivity 

More rapid economic growth 
Poverty reduction 

Long-run development 


Nonmonetary | Better health 


Greater resilience and adaptability 
More engaged citizenship 
Better choices 


Source: WDR 2018 team. 


them the skills that allow them to increase their out- 
put.5 Each additional year of schooling typically raises 
an individual's earnings by 8-10 percent, with larger 
increases for women (figure 1.1).6 This is not just 
because higher-ability or better-connected people 
(who would earn more regardless of their schooling) 
receive more education, as proposed by the signaling 
model of education. “Natural experiments” from a 
wide variety of countries—such as Honduras, Indo- 
nesia, the Philippines, the United Kingdom, and the 
United States—prove that schooling does drive the 
increased earnings (box 1.1). 

In well-functioning labor markets, education 
reduces the likelihood of unemployment. In these 
economies, high school graduates are less likely than 


Improved education and health of children/family 


Greater life satisfaction 


Increased social mobility 

Better-functioning institutions/service delivery 
Higher levels of civic engagement 

Greater social cohesion 

Reduced negative externalities 


less educated workers to lose their jobs, and if they do 
they are more likely to find another job. Educated work- 
ers are more attached to the firms they work for. They 
are also more effective at acquiring and processing 
job search information.’ Research in Finland and the 
United States finds that more schooling makes it eas- 
ier for unemployed people to find reemployment.? In 
less developed economies with large informal sectors 
and underemployment, education is associated with 
greater access to full-time jobs in the formal sector.” 


Education leads to longer lives and 
enables better life choices 

Education promotes longer, healthier lives. Around 
the world, there are strong links among education, 


Figure 1.1 More schooling is systematically associated with higher wages 


Median percentage increase in wages associated with each additional year of schooling, by country group and gender 
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Source: WDR 2018 team, using data from Montenegro and Patrinos (2017). Data at http://bit.do/WDR2018-Fig_1-1. 
Note: Figure is based on the latest available data, 1992-2012. Regions do not include high-income countries. 
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Box 1.1 Schooling as human capital formation or as a signaling device? 


Why is education associated with higher earnings? Unlike 
the human capital model, which posits that education 
increases a worker’s productivity, the signaling model of 
education states that individuals acquire education creden- 
tials to signal a high ability to potential employers. Having 
a university degree does signal perseverance, grit, and 
ability—all valuable skills for the labor market. 

But the human capital acquired typically drives the link 
from schooling to earnings, as different types of evidence 
show. First, the returns to an additional year of schooling 
for those who drop out without a high school or university 
diploma are as large as for those who complete the degree. 
Second, the wage differentials across education levels rise 
with age, whereas signaling theory suggests they should 


Source: WDR 2018 team. 
a. Layard and Psacharopoulos (1974). 


fall, because the usefulness of the signal component would 
presumably decline with age. Finally, education is an 
expensive screening strategy. 

If education worked only as a screening device, individ- 
uals with the same years of schooling should have similar 
outcomes regardless of the skills they acquired, which is 
not the case.? In many countries, individuals with higher 
measured skills have been consistently shown to earn more 
than their lower-skilled peers who have the same amount 
of schooling.® In Mexico, those high school graduates with 
higher test scores are substantially less likely to be unem- 
ployed three years after leaving school (among those who 
did not go to university) than their lower-scoring peers.‘ 


b. For example, see the results for Organisation for Economic Co-operation and Development (OECD) countries in Hanushek and others (2015) and Valerio 
and others (2016). For individual countries such as Ghana, see Glewwe (1991), or for South Africa, see Moll (1998). 


c. de Hoyos, Estrada, and Vargas (2017). 


better health outcomes, and longer lives.” Regardless 
of their race, gender, or income, more-educated indi- 
viduals in Europe and the United States have a lower 
probability of having a chronic health condition.” 
In the United States, each additional year of school- 
ing is associated with a lower probability of death, 
especially after high school (figure 1.2). One reason 
is that education makes people less likely to smoke, 
drink in excess, be overweight, or use illegal drugs. 
In the United States, education makes people less 
likely to smoke; in Uganda, more-educated individ- 
uals were more responsive to HIV/AIDS information 
campaigns." 

Educated individuals have more control over the life 
they want to pursue—often called “agency.” Increased 
agency manifests itself as a reduction in risky behavior, 
higher life satisfaction, and greater happiness. Across 
52 countries at all income levels in 2010-14, only 1 in 
10 university graduates felt that they had little or no 
control over their lives.** When the United Kingdom 
and the United States extended compulsory schooling, 
people who received more education were less likely to 
report being unhappy later in life.’* 

The positive relationship between education 
and agency is partly mediated by the positive effect 
of education on income, but there seems to be an 
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Figure 1.2 Mortality rates in the United 
States are lower for adults with more 
education 


Relative odds (log-odds coefficient) of death for groups with 
different years of education, by age, gender, and race 
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independent effect as well: the effects on crime 
and fertility, for example, are not contingent only 
on income. Schooling reduces most types of crime 
committed by adults,” as well as crime during late 
adolescence. Among 16- and 17-year-olds in the 
United Kingdom, school dropouts are three times 
more likely to commit crimes than those who have 
stayed in school, and this gap remains well into their 
early 20s. In Sweden, the United Kingdom, and the 
United States, completing high school makes youth 
less likely to commit crimes, and education is linked 
with lower crime rates elsewhere—such as in Mexico, 
where high school dropouts were more caught up in 
the violence of the war on drugs.” 

As for fertility, education reduces teen pregnancy 
and increases the control that women have over the 
size of their families. Schooling reduces teenage 
pregnancy indirectly by increasing girls’ aspirations, 
empowerment, and agency. In Turkey, primary 
school completion induced by a change in compul- 
sory schooling laws—allowing research to isolate 
the causal effects—reduced teenage fertility by 0.37 
children per woman.” School subsidies reduced teen 
pregnancy (and in some cases school dropout) in Bra- 
zil, Colombia, Kenya, Malawi, and Peru.” More gener- 
ally, women with more schooling have lower fertility 
rates. In Brazil, increased schooling among young 
women explains 40-80 percent of the decline in 
the fertility rate that began in the late 1960s.” When 
school coverage expanded in Nigeria, each additional 
year of female schooling reduced fertility by at least 
0.26 births per woman.” One reason may be that edu- 
cated women earn more, making it costlier for them 
to leave the labor market.* Education also increases 
women's use of contraception, increases their role in 
family decisions on fertility, and makes them more 
aware of the trade-offs in having children.”s 


The benefits of education are long-lasting 
Education can eliminate poverty in families. The 
incomes of parents and their children are highly 
correlated: income inequality persists, and poverty 
is transmitted from one generation to the next.” But 
improving education gives poor children a boost: in the 
United States, the children of households that moved 
to a (one standard deviation) better neighborhood 
had incomes as adults that were more than 10 percent 
higher, in part because the move improved learning,” 
Better-educated mothers raise healthier and more 
educated children. Women's education is linked to 
many health benefits for their children, from higher 
immunization rates to better nutrition to lower 


mortality.* Improvements in women’s education have 
been linked to better health outcomes for their children 
in many countries, including Brazil, Nepal, Pakistan, 
and Senegal.” Parental schooling robustly predicts 
higher educational attainment for children, even after 
controlling for other factors. And children’s ability 
to benefit from education is shaped by their parents’ 
education. In the United States, each additional year 
of a mother’s schooling increases her children’s math 
test scores by 0.1 standard deviation and significantly 
reduces behavioral problems.*° In Pakistan, mothers 
who have one more year of schooling have children 
who spend an additional hour a day studying at home.* 

Education’s benefits are especially apparent in 
changing environments. Individuals with stronger 
skills can take better advantage of new technologies and 
adapt to changing work. Indeed, experts on technolog- 
ical change have long argued that the more volatile the 
state of technology, the more productive education is.” 
Returns to primary schooling in India increased during 
the Green Revolution, with the more educated farmers 
adopting and diffusing new technologies. More gen- 
erally, globalization and advances in technology are 
putting a premium on education and skills—both cog- 
nitive and socioemotional (see spotlight 5). New skills 
facilitate the adoption of technologies and promote 
innovation,3+ with general skills enabling individu- 
als to adapt to the economic changes that occur over 
their lifetimes.*> When the North American Free Trade 
Agreement (NAFTA) increased labor productivity in 
Mexico, the benefits were concentrated among more- 
skilled workers in the richer northern states.* In gen- 
eral, returns to education are higher in economically 
free countries with institutions that allow individuals 
to adjust to shocks and market forces.*” 


Education benefits all of 
society 


Education builds human capital, which translates 
into economic growth. If improvements are faster 
among the disadvantaged, the additional growth will 
reduce poverty, reduce inequality, and promote social 
mobility. Through its effect on civic agency—mean- 
ing high levels of political engagement, trust, and 
tolerance—education can create the building blocks 
for more inclusive institutions.* Greater civic agency 
can create a political constituency for inclusive insti- 
tutions, strengthening the social contract between 
the state and its citizens. A more engaged citizenry 
can also provide political support for the reforms 
needed to realize the promise of education. 
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Education promotes economic growth 

At the national level, education underpins growth. 
Human capital can boost growth in two ways: first, 
by improving the capacity to absorb and adapt new 
technology, which will affect short- to medium-term 
growth, and, second, by catalyzing the technological 
advances that drive sustained long-term growth. 
Widespread basic education may provide a bigger 
boost for countries far from the global technological 
frontier—a group that includes most low- and middle- 
income countries.*° These countries do not need to 
push that frontier out through innovation, but they 
do need widespread basic education to absorb and 
adapt the technologies that are already available glob- 
ally. In countries close to the technological frontier, 
mainly high-income countries, higher levels of educa- 
tion can boost growth through innovation.” Although 
data limitations make empirical analysis of this rela- 
tionship challenging, many influential studies have 
concluded that higher levels of education do drive 
more rapid growth.” Growth accounting analyses 
also suggest that education can explain a significant 
share of growth—a share that may be even larger if 
unskilled workers are more productive when there 
are more skilled workers in an economy.# 

But this statistical evidence is not the only—or 
even the most compelling—evidence on the impact of 
education on growth. Countries that have sustained 
rapid growth over decades have typically shown a 
strong public commitment to expanding education, 
as well as infrastructure and health.4 Although the 
relationship flows the other way as well—in that 
rapid growth allows greater investment in all three 
sectors—research on the East Asian miracle coun- 
tries in particular flags education and human capital 
as factors in their rapid growth.** Countries such as 
the Republic of Korea reaped the benefits of their 
“progressive universalism” approach to education, 
in which they ensured high-quality basic education 


for all children early on, followed by expansion of 
high-quality secondary and tertiary opportunities.‘ 
These cases reinforce the idea that strong founda- 
tional skills drive growth early in development, but 
also that as countries approach the global technologi- 
cal frontier, they need to invest more in higher educa- 
tion and in research and development.*” 

As education coverage expands, poor people typ- 
ically benefit the most at the margin, and so income 
inequality should fall.4* A review of more than 60 
studies reveals that greater education coverage is 
associated with substantial reductions in the income 
gap between households across the income distribu- 
tion. Specifically, going from a primary enrollment 
rate of 50 to 100 percent is associated with an 8 per- 
centage point increase in the share of income going 
to households in the poorest decile.” 


Education creates the building blocks for 
inclusive institutions 

Education strengthens the political development of 
nations by promoting the civic engagement of their 
populations.®° People with more education consistently 
participate more in political activities than those with 
less education: education increases awareness and 
understanding of political issues, fosters the socializa- 
tion needed for effective political activity, and increases 
civic skills.* Evidence from a variety of settings shows 
that this relationship is causal. In the United States, 
getting more education—for example, as a result of pre- 
school programs, high school scholarships, or smaller 
class sizes—leads people to vote more often (table 1.2). 
Using changes in compulsory school laws to identify 
the causal impact of education confirms these findings 
for the United Kingdom and the United States, while 
using access to community college or changes in child 
labor laws does so for the United States.* In Benin, 
receiving more education made people more politically 
active over their lifetimes. In Nigeria, too, educational 


Table 1.2 More schooling leads to more voting 


Percent 
Graduated from high school Voted 
Program Control Treatment Control Treatment 
Perry Preschool experiment 4A 65 13 18 
“| Have a Dream” scholarships 62 79 32 A2 
STAR Experiment 85 90 42 47 
Source: Sondheimer and Green (2010). 
Note: The Perry Preschool experiment was an intensive effort to enroll children from low-income families in preschool in Ypsilanti, Michigan. The “| Have 
a Dream” scholarships were high school scholarships targeted to fifth-grade students who qualified (because of their family’s poverty status) for free or 
reduced-price lunch in Lafayette, Colorado. The STAR Experiment assigned some students in kindergarten through grade 3 in Tennessee to smaller class sizes. 


The measure of voting differs across the studies, but corresponds to a time between 2000 and 2004 when the participants would have already graduated from 


high school. 
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Figure 1.3 People with higher education hold stronger beliefs about the 


importance of democracy 


Percentage of population that believes it is “absolutely important to live in a democracy,” by country and level of education 
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Source: WDR 2018 team, using data from World Values Survey (World Values Survey Association 2015). Data at http://bit.do/WDR2018-Fig_1-3. 


expansion substantially increased the civic and politi- 
cal engagement of its beneficiaries decades later. 

As with the other effects of education, context 
matters in how education affects political views 
and engagement. In an indicator of perceptions of 
one common mechanism for political participation, 
surveys in 30 developing countries show that more- 
educated citizens are more likely to believe that living 
in a democracy is important (figure 1.3). But in Kenya, 
although more education caused young women to 
have more political knowledge, it also led them to be 
more disenchanted and more accepting of political 
violence, perhaps because democratic institutions 
were particularly fragile at the time of the research. 

Education increases trust, tolerance, and civic 
agency. Evidence from member countries of the 
Organisation for Economic Co-operation and Devel- 
opment (OECD), as well as from developing countries, 
indicates that more-educated individuals are more 
trusting and tolerant of people they know and even 
of strangers.3’ Although such cross-sectional evidence 
cannot prove a causal relationship, historical analysis 
suggests a mechanism: the spread of literacy may have 
contributed to a generalized decline in violence after 
the Middle Ages, because the ability to read others’ 
viewpoints promoted empathy.* Some educational 
environments appear to promote trust especially 
well. Data for 28 countries reveal that the openness of 
a classroom climate, or the “degree to which students 
are able to discuss political and social issues in class,” 
is positively linked to trust and tolerance.® Similarly, 
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teaching styles that encourage teamwork rather than 
a more top-down pedagogy appear to promote social 
capital: students are more likely to believe in the 
importance of civic life and the value of cooperation. 

Education makes institutions work better and 
improves public services. Educated parents are better 
able to leverage decision-making authority at the 
school level. In The Gambia, a school-based manage- 
ment program improved student learning—but only 
when there was a high level of literacy in the village.” 
Amore educated population generally demands more 
transparent use of public resources, better service 
delivery, and government accountability. Recent 
cross-country research identifies citizen complaints 
as a primary mechanism: educated citizens complain 
more, inducing officials to behave better. Education 
also appears to improve dimensions of governance: 
countries that had achieved mass education by 1870 
had less corruption in 2010.% 

Growth built on human capital rather than other 
sources (such as natural resources) may lead to fewer 
incentives for conflict, for three main reasons.® First, 
because human capital is difficult to appropriate, 
conquest of a well-educated population may be less 
rewarding than seizure of natural resources or even 
physical capital.°> Second, education raises the oppor- 
tunity cost of fighting: it is easier to recruit people 
who have poor job prospects.® Third, as discussed, 
education can promote tolerance and cooperation, 
thereby reducing the propensity to turn to violence to 
resolve conflicts.” 
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Learning and the promise of 
education 


Education can be a powerful tool for individual and 
societal empowerment, but its benefits are not auto- 
matic. It is not just that education cannot do it alone, 
in that much also has to go right in other sectors of 


Box 1.2 Education can’t do it alone 


Economics, politics, and society shape the returns to educa- 
tion. Education systems do not function in a vacuum; they 
are part of broader economic, political, and social institu- 
tions. For example, does a society uphold property rights? 
If not, entrepreneurs are unlikely to invest in risky new ven- 
tures, which cuts into job creation and reduces education’s 
returns in the labor market. Are there regulations to pre- 
vent fraud? If not, those with education might find it more 
profitable to engage in socially unproductive but financially 
remunerative activities. Are women restricted from working 
outside the home? If so, the economic returns from educa- 
tion will be unavailable to them. These are all examples of 
how formal or informal institutions influence education’s 
returns. In general, reliable institutions that implement the 
rule of law, reduce corruption, and protect property rights 
are associated with higher returns to human capital. 

Here are several examples of how problems elsewhere 
in the economy or society reduce education’s returns: 

Low demand for educated labor reduces the return to 
skills. Education’s returns depend on the interplay between 
demand and supply forces in the labor market. If the 
demand for educated labor is low relative to supply, then 
the returns to education will be low or declining.° In urban 
China, the returns to education rose from 4 percent a year 
of schooling in 1988 to 10 percent in 2001, with most of the 
increase attributable to institutional reforms that increased 
the demand for skilled labor.© More generally, shifts from 
planned to market economies have increased the returns 
to human capital.4 When the investment climate is poor,® 
both investment and demand for labor by private firms are 
lower, reducing the returns to education.‘ 

Countries can incentivize the wrong things. Many edu- 
cated youth in parts of the developing world queue for 
jobs in already large public sectors. In several countries, 
political candidates compete in terms of their ability to 
offer patronage or public employment to their supporters.2 
In several North African countries, for example, it was not 
uncommon in the past for governments to guarantee public 
employment opportunities for all university graduates, and 
the public sector remains the employer of a large share 
of wage earners." In such situations, individual returns to 
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the economy and society (box 1.2). Another problem is 
that if an education system is managed poorly, it can 
promote social “bads” instead of social “goods.” First, 
education can deepen cleavages between favored 
and disadvantaged groups. Young people from poor, 
rural, and otherwise disadvantaged households not 
only complete less schooling, but also learn much 


education might be high (for those who land public sector 
jobs), but the impact of education on growth will be low 
because improved cognitive skills are not used in ways that 
will increase productivity the most.' 

Discriminatory norms distort the benefits of education. 
Prevailing norms on ethnic or gender discrimination can 
strongly mediate the returns to education for these groups. In 
many societies, social norms severely restrict women’s access 
to economic opportunities! Two studies found that nearly 90 
percent of women in northern India (from the state of Uttar 
Pradesh) and Nigeria (of Hausa ethnicity) felt they needed 
their husband’s permission to work. But norms vary substan- 
tially: in the Ethiopian capital, this share was only 28 percent.‘ 

Such norms do not always operate through open dis- 
crimination. Labor market segregation along occupational 
and social lines is often covert. Occupational gender seg- 
regation is a strong feature of many labor markets across 
the world.' In Organisation for Economic Co-operation and 
Development (OECD) countries, women dominate the ser- 
vice sector, whereas men are overrepresented in industry.” 
In addition to horizontal segregation, women also face a 
“glass ceiling” or “vertical segregation” because they do not 
advance in their careers as fast or as far as men. In OECD 
countries, just a third of managers were women in 2013, with 
small variations across countries." Labor market segregation 
may also exist along socioeconomic lines.° In the 1960s and 
1970s, during a period of rapid economic growth in Chile, 
education was significant in determining occupational 
attainment for the middle class. For the upper class and the 
very poor, education was less important, and intergenera- 
tional status inheritance was much more likely.’ In Jamaica, 
a country with a rigid class structure, the massive expansion 
of educational opportunities at the secondary level did little 
to increase the permeability of social structure.* 

The very people who are constrained by social norms 
may become complicit in perpetuating them. A study of stu- 
dents newly admitted to an elite master’s in business admin- 
istration (MBA) program in the United States found that 
single women reported lower desired compensation when 
they believed their classmates would see their responses. 
No such differences were observed for men or for women 


(Box continues next page) 


Box 1.2 Education can’t do it alone (continued) 


who were not single, suggesting that single women were 
reluctant to signal personality traits, such as ambition, that 
they perceived to be undesirable in the marriage market.’ 
Social norms can operate in much the same way to inhibit 
male access to opportunities. Case studies in Australia and 
Jamaica suggest that underachievement among boys is 
linked to notions of education being a “feminized” realm 
that clashes with expectations of “masculine” behavior.s 
When getting a job depends on informal institutions, 
education is less useful.‘ |n Kolkata (formerly Calcutta), India, 


Source: WDR 2018 team. 
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less while in school (see part II of this Report). In such 
cases, education does little to enhance social mobility. 
Second, leaders sometimes abuse education systems 
for political ends and in ways that reinforce autocracy 
or the social exclusion of certain groups. 

Finally, schooling is not the same as learning. Edu- 
cation is an imprecise word, and so it must be clearly 
defined. Schooling is the time a student spends in 
classrooms, whereas learning is the outcome—what 
the student takes away from schooling. This distinc- 
tion is crucial: around the world, many students learn 
little (figure 1.4). To be sure, many students learn 
something, even in settings facing huge challenges. 
And students enjoy some benefits from education 
regardless of whether they are learning. When schools 
serve as oases of security in violent areas, or when 
participation in schooling keeps adolescent girls from 
becoming pregnant, these are real societal benefits. 
When graduates can use their degrees to open doors 
to employment, that opportunity changes their lives, 
even when the degree represents less learning than 
it should. 

Intuitively, many of education's benefits depend on 
the skills that students develop in school. As workers, 
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45 percent of employees reported that they helped a 
friend or relative get a job with their current employer." 
Nearly 60 percent of enterprises surveyed in 14 countries 
in Sub-Saharan Africa report that their most recent position 
was filled through contacts with “family/friends.” This 
finding applies as well to places where labor markets are 
segmented by kinship and socioeconomic class.” Informal 
networks can also be particularly important for certain 
subpopulations—for example, among Mexican migrants in 
the United States.” 
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Figure 1.4 Learning varies widely across countries; 
in 6 of the 10 countries assessed, only half or fewer 


of primary completers can read 


Literacy rates at successive education levels, selected countries 
100 - 


75 5 
5 
9 50-4 
) 
a 
25 5 
0) T : T T T 
No formal Some Completed Some Completed Some or 
education _ primary primary secondary secondary completed 
tertiary 


Highest level of educational attainment 


— Bangladesh s+ Indonesia ss Rwanda 

«= Ghana — Kenya - = Tanzania 

— India «« Nigeria = = Uganda 
— Pakistan 
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Note: Literacy is defined as being able to read a three-sentence passage either “fluently without help” or 


“well but with a little help.” 
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people need a range of skills—cognitive, socioemo- 
tional, technical—to be productive and innovative. As 
parents, they need literacy to read to their children or 
to interpret medication labels, and they need numer- 
acy to budget for their futures. As citizens, people need 
literacy and numeracy, as well as higher-order rea- 
soning abilities, to evaluate politicians’ promises. As 
community members, they need the sense of agency 
that comes from developing mastery. None of these 
capabilities flows automatically from simply attend- 
ing school; all depend on learning while in school. 

Research on the benefits of education has begun 
to reflect this distinction between schooling and 
learning. In the past, most empirical research equated 
education with schooling—whether measured by 
school enrollment, number of years of schooling, or 
degrees acquired—in part because of lack of other 
good measures of education. But as the focus on 
learning has grown, some studies have explored the 
effects of the skills that students acquire. The results 
confirm the intuition: skills matter. 

The channel by which schooling accelerates eco- 
nomic growth appears to be through boosting learn- 
ing and skills.’ Thanks to the growing availability of 
large-scale student assessments, it is now possible to 
explore how learning mediates the relationship from 
schooling to economic growth.” While the relation- 
ship between test scores and growth is strong even 


after controlling for the years of schooling completed, 
years of schooling do not predict growth once test 
scores are taken into account (figure 1.5), or they 
become only marginally significant.” In other words, 
what matters is less the years of education completed 
than the knowledge that students acquire while in 
school. Simulations show that providing all students 
with basic cognitive skills could massively boost eco- 
nomic outcomes, especially in developing countries 
(figure 1.6).” This finding suggests that cross-country 
comparisons of the years of schooling completed— 
especially when used to explain economic phenom- 
ena—could be misguided if they do not account for 
the differences in skills acquired during those years 
(box 1.3). 

At the micro level, too, growing evidence shows 
that skills acquisition determines how much individ- 
uals gain from schooling. For example, learning—not 
just schooling—matters in how education affects 
earnings. Across 23 OECD countries, as well as in a 
number of other countries, simple measures of foun- 
dational skills such as numeracy and reading profi- 
ciency explain hourly earnings over and above the 
effect of years of schooling completed.” These effects 
extend beyond the labor market. Across 10 low- and 
middle-income countries, schooling improved mea- 
sures of financial behavior only when it was associ- 
ated with increased reading ability.”7 When people 


Figure 1.5 What matters for growth is learning 


Annual average per capita growth in GDP, 1970-2015, conditional on test scores, years of schooling completed, and initial GDP 
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Figure 1.6 Increasing learning would yield major economic benefits 


Simulated additional GDP between 2015 and 2090 attributable to increased learning (relative to current GDP), by scenario, selected countries 
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Note: PISA = Programme for International Student Assessment. 


had acquired more schooling but not more literacy— 
which was common in these countries—financial 
behaviors did not change. Socioemotional skills 
matter as well: various measures have been shown 
to significantly predict earnings over and above the 
effects of schooling and cognitive skills.” 

Learning matters for health, too. Numerous stud- 
ies have documented the benefits of girls’ schooling 
on outcomes such as lower fertility or better child sur- 
vival, but these studies do not typically distinguish 
between learning and schooling. There are excep- 
tions, however. In Morocco, research showed that 
maternal education improved child health through 
its effects on the ability of mothers to acquire health 
knowledge.” Globally, data from 48 developing coun- 
tries show that learning is responsible for much of 
these gains. Each additional year of female primary 
schooling is associated with roughly six fewer deaths 
per 1,000 live births, but the effect is about two-thirds 
larger in the countries where schooling delivers the 
most learning (compared with the least).’° 

Even limited measures of skills explain a lot. The 
measures used in the studies just noted are often 
natrow, capturing only simple numeracy or reading 
proficiency. Sometimes, the measures are coarse. For 
example, the 48-country study of the relationship 
between schooling and health uses as its measure of 
literacy whether a woman can read a single sentence 


such as “Parents love their children” or “Farming is 
hard work.” Yet even these highly imperfect mea- 
sures of skills have considerable predictive and 
explanatory power. If better measures of skills were 
available, skills would likely explain even more of the 
impacts of education—and the role remaining for the 
simple schooling measure (which typically retains 
predictive power in these analyses) would be further 
diminished. 

Finally, learning promotes social mobility. The 
research cited earlier on intergenerational social 
mobility in the United States also investigated which 
educational mechanisms were responsible. One can- 
didate is school quality based on inputs, such as school 
spending and class size, and these measures did have 
some predictive power. But learning outcomes turn 
out to be especially important: the test scores of the 
community in which a child lives (adjusted for the 
income of that community) are among the strongest 
predictors of social mobility later in life.” 

The literature on the benefits of learning is still 
growing, with much more research needed. But both 
common sense and the emerging research literature 
make it clear that if investigators care about the ben- 
efits of education, they should focus on whether stu- 
dents are learning—not just on how well schools are 
equipped or even how long students stay in school. 
Part II of this Report takes up this issue. 
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Box 1.3 Comparing attainment across countries and economies— 


learning-adjusted years of schooling 


A given number of years in school leads to much more 
learning in some economies than in others. Because they 
do not account for these differences, standard compari- 
sons of schooling attainment may be misleading. But how 
should they be adjusted to make meaningful comparisons? 

One approach is to draw on measures of student learning 
that are standardized across different economies to adjust 
for quality. International assessments such as the Trends 
in International Mathematics and Science Study (TIMSS) 
or the Programme for International Student Assessment 
(PISA) provide such measures. If one is willing to assume 
that the average learning trajectory across economies is 
linear—starting at no learning when learners enter school 
and growing at a constant rate to grade 8—then the ratio 
of scores across two economies would reflect the relative 
learning per year in one economy versus the other. For 
example, if economy A has twice the score of economy B in 
grade 8, then, on average, a year of schooling in economy A 
may be considered twice as effective. 


Two important facts support the credibility of this 
analysis: first, the TIMSS score ratios across economies for 
grade 4 are similar to those for grade 8; and second, PISA 
scores tend to increase linearly across the grades in which 
that test is administered. 

What might such an adjustment reveal? An illustration 
using TIMSS math scores from 2015 confirms that years of 
schooling are indeed very different from learning-adjusted 
years, and this difference varies a lot across economies. 
Whereas people ages 25-29 in Hong Kong SAR, China, and 
the United States have similar average years of schooling 
(14 and 13.5, respectively), the number of learning-adjusted 
schooling years in the United States is almost two years less 
(figure B1.3.1). And whereas young Singaporeans have only 
30 percent more schooling than young Jordanians by the 
standard measure, the learning-adjusted measure shows 
Singapore outpaces Jordan by 109 percent in effective 
schooling years. 


Figure B1.3.1 There can be a large gap between learning-adjusted and 


unadjusted years of schooling 


Years of actual and learning-adjusted schooling among young people, ages 25-29, illustrated using TIMSS data 
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4 To take learning seriously, start 
by measuring it 


The great schooling 
expansion—and those 
it has left behind 


In 1945, when Indonesia declared independence, only 5 percent of its people could 
read and write. In 2015, 95 percent could (UIS 2016). 


In Nepal in 1981, only one in five adults were literate. In 2015, nearly two-thirds 


were (UIS 2016). 


Over the last 50 years, schooling has expanded dra- 
matically in most low- and middle-income countries. 
In some countries, this expansion has been at his- 
torically unprecedented rates. Another pattern is the 
rapid expansion of postprimary education, though 
many young people remain excluded from even 
primary education. So even in countries with strong 
schooling expansions, exclusions due to poverty, gen- 
der, ethnicity, disability, and location persist. Fragile 
and postconflict countries also remain glaring excep- 
tions to the global boom in schooling. 


Most children have access to 
basic education 


Schooling has expanded almost universally. In 1970 
the gross primary enrollment rate was 68 percent in 
Sub-Saharan Africa and 47 percent in South Asia. By 
2010, that rate was above 100 percent in both regions.’ 
These numbers reflect the progress made in nearly all 
countries regardless of regime type, rate of economic 
growth, or quality of governance.” As a result, most 
children today enroll in primary school—and every 
new cohort of young people spends more time in 
school than previous ones. 
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The recent expansion in schooling in low- 
income countries is especially remarkable in its 
scope and speed. The years of schooling completed 
by the average adult in the developing world more 
than tripled between 1950 and 2010—from 2.0 to 
7.2 years. This rate is historically unprecedented. In 
Zambia, secondary enrollment increased by nearly 
75 percentage points between 2000 and 2010, faster 
than the rate experienced by any high-income 
country during its fastest phase of secondary 
expansion.5 It took the United States 40 years—from 
1870 to 1910—to increase girls’ enrollments from 57 
percent to 88 percent. Morocco achieved a similar 
increase in just 11 years.® Accordingly, the enrollment 
gaps between low- and high-income countries are 
closing. By 2008 the average low-income country 
was enrolling students in primary school at nearly 
the same rate as the average high-income country 
(figure 2.1). Despite these gains, there is a large stock 
of uneducated adults—322 million in South Asia 
alone (figure 2.2). 

Previously marginalized groups, especially girls, 
are now much more likely to start primary school. 
Between 2000 and 2014, the number of out-of-school 
children fell by about 112 million.’ At the same time, 


Figure 2.1 School enrollments have shot up in developing countries 


Net enrollment rates, by country group (1820-2010) 
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the share of girls enrolled in basic education reached 
a historic high.’ In primary and secondary schools 
in the developing world, the ratio of girls to boys 
jumped from 0.84 to 0.96 between 1991 and 20072 
Indeed, girls outnumber boys in secondary school 
in 38 developing countries (out of 121 for which data 
are available)..° Gender parity, however, has yet to be 
achieved; 62 million girls between the ages of 6 and 
15 years are still out of school," with the highest con- 
centrations in West and South Asia and Sub-Saharan 
Africa.” Although many girls start primary school, 
their likelihood of completing it remains low in some 
countries. By 2014 the primary enrollment rate of 
girls in low-income countries was at 78 percent, but 
their completion rate was only 63 percent." 

The strongest schooling expansions have occurred 
at the primary level, leading to a sharp increase in 
the demand for secondary education. Secondary 
enrollment rates have risen above 50 percent in every 
region except parts of Sub-Saharan Africa. But at that 
level there remain big gaps between low- and high-in- 
come countries, especially for completion. In 2016 the 
secondary completion rate was 96 percent in high- 
income Organisation for Economic Cooperation and 


Figure 2.2 Most of the world’s population with less 
than a primary education is in South Asia, but rates 
are similar in Sub-Saharan Africa 

Stock of educational attainment (ages 15-64), by country group (2010) 
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Figure 2.3 National income is 
correlated with the gap between 
primary and lower secondary 
completion rates 


Distribution of completion rates across countries, by country 
group and level of schooling 
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Development (OECD) countries, but only 35 percent 
in low-income countries (figure 2.3). 

Developing countries are following a very dif- 
ferent path to schooling expansion than developed 
countries did. Low-income countries are leapfrogging 
the progress experienced by high-income countries— 
with strong expansion in postprimary education 
even while primary education remains inaccessible 
to many young people (figure 2.4). 
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Poverty, gender, ethnicity, 
disability, and location 
explain most remaining 
schooling disparities 


Mawut, a refugee from South Sudan, lived in a refugee 
camp in Kenya for years so he could finish primary 
school. “In 2010 my sister [decided to return] to Sudan 
and I decided not to follow her because I knew if I 

did so, that would be the end of my education. I went 
to Kakuma Refugee Camp with my brother, where 

I completed the two remaining years of my primary 
course. I passed very well despite the problems that 
Thad experienced” (Kelland 2016). 


Nadya is a 25-year-old from Mashkhail, a remote 
district in southeastern Afghanistan. “I am the only 
literate woman in this heavily populated province 
working outside home and, more important, the only 
female teacher in this traditional province. ... When 
the elders of Mashkhail found out I was literate... 
[they asked] my husband if I could volunteer teaching 
their daughters, mostly those older girls who were not 
allowed to be taught by a male teacher” (IRIN 2003). 


Conflict-affected countries remain a glaring exception 
to the global schooling expansion (box 2.1). The net 
primary enrollment rate in conflict-affected South 
Sudan was 41 percent in 2011; the enrollment rate in 
neighboring Ethiopia was 78 percent. Conflict-af- 
fected countries are home to more than a third of out- 
of-school children. Children in these countries are 
less likely to complete school—30 percent less likely 
for primary, 50 percent less likely for lower second- 
ary.” They have higher dropout rates, lower comple- 
tion rates, higher gender disparities, lower literacy 
levels, and disproportionately high out-of-school 
numbers." Conflict can also erase past gains. The 
Syrian Arab Republic had achieved universal primary 
enrollment in 2000. But in 2013, 1.8 million children 
were out of school due to conflict. 

Exclusions based on poverty, location, gender, 
and ethnicity persist (figure 2.5). In 2014 an estimated 
61 million primary school-age children and 202 mil- 
lion secondary school-age youth—with a dispropor- 
tionate share from poor households—were out of 
school.?° Only about a quarter of the poorest children 
in low-income countries—compared with three- 
quarters in the richest—complete primary school.” 


These gaps are even larger when disaggregating by 
gender, where the double exclusions from gender and 
poverty mean that only 25 percent of the poorest girls 
in low-income countries complete primary school.” 
In some contexts, ethnicity can be an important pre- 
dictor of education access. In 2011 only 10 percent of 
adult Roma had completed secondary education in 
Romania, compared with 58 percent of non-Roma 
living nearby.? Children of indigenous groups in 
Latin America are more than twice as likely as other 
children to be working.** 

Children from the poorest families are less likely to 
start school. Those who do start school are more likely 
to drop out early, though at varying rates across coun- 
tries. In some countries, such as Mali and Pakistan, the 
effect of poverty on education levels is already visible 
at the start of primary school. In Indonesia and Peru, 
gaps emerge later (figure 2.6). In nearly every country, 
parents’ wealth and education attainment are the main 
determinants of their children’s education.”> On aver- 
age, in developing countries there is a 32 percentage 
point gap between the chances of children in the poor- 
est and richest quintiles completing primary school— 
with these wealth-related inequalities increasing in 10 
of 25 such countries for which data are available.*° The 
poorest people are the most affected by any marginal 
increase in or contraction of public spending on edu- 
cation.” Not surprisingly, then, making school more 


Figure 2.4 Lower-income countries are rapidly 

expanding secondary education at a time when 
much of their population has not yet completed 
primary school 


Evolution in the stock of educational attainment (ages 15-64), by present-day 
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Source: WDR 2018 team, using data from Lee and Lee (2016). Data at http://bit.do/WDR2018-Fig_ 2-4. 


Box 2.1 Access denied: The effects of fragility, conflict, and violence 


Children living in the most fragile contexts make up about 20 
percent of the world’s primary school-age population. Yet 
they constitute about 50 percent of those not in school, an 
increase from 42 percent in 2008.? Children in fragile states 
are up to three times more likely to be out of school than 
those living in nonconflict contexts, and they are far more 
likely to drop out of primary school before completion. Even 
when fragility, conflict, and violence do not directly disrupt 
access, they can affect learning by changing the pedagogical 
experience, such as through lack of teachers and resources 
or trauma from violence. Conflict tends to exacerbate exclu- 
sions based on ethnicity, religion, or gender. 

Education systems can exacerbate conflict through, 
for example, ethnic, religious, or gender stereotyping in 
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textbooks. Other manifestations include the singular use of 
a nonindigenous language as part of noninclusive “nation 
building,” the denial of education to marginalized groups, 
the manipulation of history for political purposes, and the 
use of geography lessons to promote a particular ideolog- 
ical view. 

Displaced children face significant obstacles to learning. 
Only one out of every two refugee children has access to 
primary education; a refugee child is five times more likely 
than the average child to be out of school.® Education for 
these vulnerable children can provide a sense of normalcy 
and structure, with high returns.‘ But the challenge of 
equipping these children with the necessary skills and 
knowledge has often fallen to host governments, some 


(Box continues next page) 
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of which are already struggling to provide quality educa- 
tion for their own populations. Lebanon, for example, has 
increased the size of its public education system by almost 
50 percent since 2011, largely because of the conflict in the 
Syrian Arab Republic. In Lebanon, refugees make up almost 
a third of the total enrollment in education.‘ 

In addition to conflict and violence at the societal 
level, school-level violence hinders learning. Physical and 
psychological violence are common forms of so-called dis- 
cipline, with students in many parts of the world routinely 
subjected to corporal punishment. Across three major 


Source: Commins (2017). 


a. UNESCO (2013). 

b. UNHCR (2016). 

c. Burde and others (2015). 
d. World Bank (2016a). 

e. NCCM and UNICEF (2015). 


affordable—both in terms of defraying direct costs and 
compensating for opportunity costs—increases the 
school participation of children from poorer families.” 

Globally, girls are twice as likely as boys never to 
start school, which results in lower school completion 
rates.” In Sub-Saharan Africa, poor rural girls are 
seven times less likely than nonpoor urban boys to 
complete school; less than 1 in 20 of these girls is on 


a. Richest-poorest 


b. Urban-rural 


cities in one large country, for example, more than half of 
all students had been subjected to some form of violent 
punishment at school.° One-quarter of the children who 
were physically punished said they sustained injuries as 
a result. Children already discriminated against based on 
disability, poverty, caste, class, ethnicity, or sexual orien- 
tation are more likely than their peers to suffer corporal 
punishment. In some contexts, sexual violence in schools 
is also an issue—for example, authority figures may abuse 
their power by demanding sex in return for better grades or 
for waiving school fees. 


track to complete secondary school.*° Even in regions 
where gender parity has been achieved at the primary 
level, such as North Africa and West Asia, gender 
disparities in enrollment exist at the lower secondary 
school level and become more pronounced in upper 
secondary school.* 

Gender reinforces other disadvantages. It often 
compounds disadvantages related to socioeconomic 


Figure 2.5 School completion is higher for richer and urban families, but gender gaps are more 
context-dependent 


Gaps in grade 6 completion rates (percent) for 15- to 19-year-olds, by wealth, location, and gender 
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Figure 2.6 Multiple exclusions: Girls from poor households often have the lowest rates of 


education attainment 


Percentage of youth (ages 15-19) who have completed each grade, by wealth quintile and gender, selected countries (2012) 
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status, ethnicity, location, religion, sexual orientation, 
disability, age, and race.” Across 44 countries, boys 
in the poorer half of the population were almost 75 
percent more likely to complete grade 5 than girls; 
by contrast, in the richer half of the population the 
boys’ advantage was less than 20 percent.3 Nearly 70 
percent of all girls who were not enrolled in primary 
school in 2006 came from socially excluded groups.# 

Children with disabilities face substantial obsta- 
cles to education—and substantially lower participa- 
tion in school.5 In Burkina Faso, having a disability 
increases the probability of a child never attending 
school by about two times.3° Even in countries with 
high overall primary school enrollments, children 
with disabilities are still significantly less likely to 
attend school. In Moldova, 97 percent of children 
without disabilities between the ages of 7 and 15 years 
are enrolled in primary school, whereas only 58 per- 
cent of children with disabilities are in school.” At the 
same time, quality education for children with dis- 
abilities has significant economic and social returns. 
Across 12 developing countries, each additional year 
of schooling for people with a disability decreased 
their probability of being in the poorest two quintiles 
by between 2 and 5 percentage points. 


For poor parents, schooling 
requires trade-offs 


Millions of poor parents make difficult choices about 
whether to educate their children. This cost-benefit 
assessment—where costs include both the direct cost 
of school and the opportunity cost of a child’s time 
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outside it—determines their children’s enrollment, 
grade completion, and learning outcomes.*® In some 
contexts, this calculus might involve sending just 
some—but not all—children to school. For example, 
only about a quarter of rural households in Burkina 
Faso enroll all their children in school.? Cutting 
the cost of schooling, therefore, significantly raises 
school participation by children from poorer fami- 
lies.‘ The removal of direct costs to schooling through 
universal primary education in Uganda increased 
primary enrollment by over 60 percent and lowered 
cost-related dropouts by over 33 percentage points. 
In Malawi, free primary education increased enroll- 
ment by half, favoring girls and poor people.# 

For some poor households, distance to the nearest 
school is a predictor of school participation, espe- 
cially where social norms or safety concerns make it 
difficult for children—particularly girls—to travel far 
from home.“ In Indonesia, each school built for every 
1,000 children increased education by an average 
of 0.12 years.*5 But school availability matters most 
when starting from a point of low availability, and 
school construction by itself can only do so much. 

Perceived returns, whether in the labor market 
or in realms such as the marriage “market,” often 
determine how willing poor parents are to send their 
children to school.47 Thus the demand for education 
is likely to be lower if parents underestimate the 
returns to education.*® Parents might also misunder- 
stand how the returns to education vary by level. If 
they believe the returns from secondary education 
are significantly higher than the returns from pri- 
mary, it might make more sense to focus on sending 
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their brightest child to secondary school rather than 
sending all their children to primary school.” In the 
face of extreme poverty and perceived low returns 
to schooling, poor people might restrict their overall 
aspirations for education.®° 

Parents’ perceptions about whether their children 
are learning affect their decisions about whether to 
continue schooling. In most low-income countries, 
students who have to repeat grades or who exceed 
the average age of their classmates by several years 
are more likely to drop out before completing primary 
school.* In the Philippines, a child’s perceived educa- 
tional ability is a key determinant of whether parents 
choose to keep him or her in school, or in the work- 
place instead.” Similarly, adolescents in Burkina Faso 
are far more likely to be enrolled when they score 
high on an intelligence test, but much less likely if 
their sibling scores higher. 

When parents perceive the education available to 
be of low quality, it also affects their choices about 
schooling. Although parental perceptions of school 
quality depend on a variety of factors—from the phys- 
ical condition of the school to teacher punctuality— 
student learning outcomes are a critical aspect. 
Holding student ability and achievement constant, 
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families in the Arab Republic of Egypt could differ- 
entiate schools by their quality of education—and 
students attending lower-quality schools were more 
likely to drop out. Indeed, parents seem willing 
to bypass lower-quality public schools in favor of 
higher-quality, more remote public ones, or better- 
quality private ones with higher fees.‘ 


KKK 


Worldwide, parents and students have incredible 
faith in the power of education. People everywhere 
know that education can transform lives, including 
the lives of their children. The rapid growth in school- 
ing in poor rural areas around the world is indicative 
of this demand.** Almost all parents say they want 
their children to complete school—even parents who 
did not attend school themselves. The last 50 years 
have generated high hopes of strong returns to educa- 
tion and a great drive toward universal school enroll- 
ment. But much remains to be done. Achieving this 
promise means addressing gaps in school participa- 
tion and ensuring that education leads to learning. As 
chapter 3 shows, the great schooling expansion has 
not translated into commensurate gains in learning. 
Attention must now shift to ensuring learning for all. 
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SPOTLIGHT 1 


The biology of learning 


Research has dramatically expanded our understand- 
ing of how the brain works—and therefore how peo- 
ple learn. The brain is very malleable: it adapts to its 
surroundings. This phenomenon is called neuroplasti- 
city, which means the ability to learn is dictated not 
only by genetic endowments, but also by how genes 
interact with experiences and environmental inputs. 
Genes govern when specific brain circuits are formed, 
but experiences can turn those genes on or off, as well 
as determine which neural connections—synapses— 
survive over the life cycle. Environmental inputs such 
as caregivers’ or teachers’ stimulation, or nutrition, or 
violence shape the architecture of the brain from the 
formative years on.’ 

The brain is malleable throughout life, even if 
most brain development is completed by late adoles- 
cence or early adulthood. The fastest synaptic growth 
(thus malleability) occurs between the prenatal period 
and age 3 (1 million new neural connections a second), 
with growth then gradually slowing Because differ- 
ent parts of the brain develop at different times, and 
because neuroplasticity is highest during develop- 
mental stages, not all areas of the brain are equally 
malleable at the same time (figure S1.1). The periods 
of greatest plasticity, or “sensitive periods,’ whose 
length varies widely by brain region, are character- 
ized by an initial stage in which the brain develops far 
more synapses than it needs. That stage is followed by 
synaptic pruning in which, to maximize efficiency in 
brain functionality, the neural connections used more 
often grow more permanent, while those used less 
are discarded to reach optimal levels of synapses (that 
is, the adult level of synapses in figure S1.1).3 Because 
most sensitive periods take place early in life, a 3-year- 
old has, in total, far more brain synapses (about 1 qua- 
drillion) than an adult (100-500 trillion). 
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Although different parts of the brain have dif- 
ferent sensitive periods, their development is inter- 
dependent. Neural circuits (series of synapses) form 
sequentially and cumulatively: simpler networks 
develop first, more complex ones later. Just as with 
the construction of a house, the robustness of pro- 
gressively more complex brain structures depends 
on the robustness of foundational ones. For example, 
the development of increasingly complex skills and 
functions builds on circuits formed earlier: linguis- 
tic development relies on visual and auditory func- 
tions that are dependent on neural circuits lower 
in the hierarchy, which are most malleable earlier 
in life; neural circuits that support higher cognitive 
functions, most malleable until as late as adoles- 
cence, build on sensorial stimuli as well as linguistic 
development.* Moreover, physical, sensory-motor, 
cognitive, and socioemotional development are inter- 
dependent, constituting a web of dynamic links that 
ultimately determine a person's ability to thrive. For 
example, higher levels of health promote learning; 
emotional security fosters child exploration, which 
leads to learning; and higher self-regulation reduces 
health risks. 

A range of enriching experiences leads to more 
complex synapses, but cumulative exposure to risk 
factors (such as neglect or violence) either eliminates 
synapses associated with healthy brain development, 
or it consolidates those associated with unhealthy 
development. Experiences affect the architecture of 
the brain in part because of the hormonal response 
they trigger. Hormones such as dopamine (trig- 
gered when the brain encounters novelty) stimulate 
information absorption,® whereas hormones such as 
cortisol (associated with stress as well as negative 
emotions) can shut off learning.’ 


Figure S1.1 Synapse development over the first 20 years of life 
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Sources: Parker (2015); Thompson and Nelson (2001). Adapted with permission from Lawson Parker/National Geographic Creative; further permission required 
for reuse. Synapse drawings based on Golgi stain preparations (1939-1967) by J. L. Conel. 


Note: The figure is a representation of synapse development for selected brain functions over the life course. Not drawn to scale. 


The available insights on brain development have 
implications for investments in learning and skill 
formation. Because brain malleability is much greater 
earlier in life and brain development is sequential 
and cumulative, establishing sound foundations can 
lead to a virtuous cycle of skill acquisition. More- 
over, investment in experiences and environmental 
inputs that foster learning at the very earliest stages 
increases the impact of investments at later stages: 
skills beget skills. Weak foundations, by contrast, result 
in the accumulation of learning gaps, as well as higher 
risks of poor biological development that hamper skill 
formation—with repercussions over the life cycle 
(see chapter 5). Yet the optimal periods for cultivat- 
ing higher-order cognitive and socioemotional skills 
occur throughout childhood, adolescence, and early 
adulthood.? Furthermore, the brain's ability to adapt 
to its environment, learn, and acquire new skills 
continues throughout life (that is, the experience- 
dependent synapse formation in figure S1.1). Thus 
investments in environmental inputs are needed well 
beyond early childhood to sustain learning along with 
skills development. 


Interventions to improve learning and skills 
should place a greater emphasis on the areas of the 
brain that are the most malleable over the life course. 
Children’s brains are most efficient at incorporating 
new information through exploration, play, and inter- 
actions with caring adults or peers. Because of this 
receptivity, preschool programs should concentrate 
on building foundational skills through developmen- 
tally appropriate program structures that emphasize 
play and interaction.’”° Although foundational cogni- 
tive skills become less malleable after age 10, some 
areas associated with socioemotional development 
remain highly malleable through early adulthood. 
Accordingly, interventions that aim to improve the 
school-to-work transition, as well as social inclusion 
for youth with weak foundational skills, may prove 
most effective when they emphasize socioemotional 
skills." 

Teaching strategies can deeply influence how 
students approach challenges in and out of school. 
Because the brain thrives when exposed to novelty, 
incorporating enriching opportunities for learning 
along with exploration may lead to better learning 
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outcomes. Finally, intense stress or sustained nega- 
tive emotions—such as those associated with crises or 
acute deprivation, where multiple stressors coexist— 
interfere with the brain's ability to learn, retain, and 
use information. Extended exposure to stressors is 
toxic for biological systems, particularly for develop- 
ing brains, and it may impede disadvantaged children 
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The many faces of the 
learning crisis 


Rabia Nura, a 16-year-old girl from Kano in northern Nigeria, goes to school despite 
ever-present threats from Boko Haram. She is determined to become a doctor 
(Smith 2014). But 37 million African children will learn so little in school that they 
will not be much better off than kids who never attend school (van Fleet 2012). 


The global schooling expansion hides another statis- 
tic: for millions, schooling is not producing enough 
learning. Learning outcomes in basic education are so 
low, in so many contexts, that the developing world 
is facing a learning crisis. In many low-income coun- 
tries, learning levels are low in an absolute sense, 
while in many middle-income countries average 
learning levels remain far behind those in high- 
income countries. The learning crisis disproportion- 
ately affects children from poor households: they are 
far more likely to leave school without acquiring basic 
skills like literacy or numeracy. Ultimately, the learn- 
ing crisis translates into severe shortcomings in the 
skills of the workforce. 


For too many, learning isn’t 
happening 


In South Africa, 27 percent of 12-year-olds 
were enrolled in grade 6 but were functionally 
illiterate; in Zambia that share was 44 percent 

(Hungi and others 2010). 


Globally, 125 million children are not acquiring func- 
tional literacy or numeracy, even after spending at 
least four years in school.’ In Malawi and Zambia 
in 2012, more than 89 percent of students could not 


read a single word by the end of grade 2.2 In Guyana 
in 2008 (when the most recent data were collected), 
that share was 29 percent at the start of grade 3.3 
Asimilar picture emerges for numeracy. In rural India 
in 2016, less than 28 percent of students in grade 3 
could master double-digit subtraction.* Emerging 
data on student achievement show that, for millions, 
schooling is producing little learning in crucial early 
grades.5 

Millions complete primary education without 
acquiring the basic competencies needed for further 
learning. According to a 2014 regional assessment, 
among grade 6 students in West and Central Africa, 
nearly 58 percent are not sufficiently competent in 
reading or mathematics to continue schooling (figure 
3.1).° Similarly, the most recently available regional 
assessment of grade 6 students in southern and East 
Africa (from 2007) shows that 37 percent are not com- 
petent in reading, and more than 60 percent are not 
competent in mathematics (figure 3.2).’ This lack of 
basic competency is systematically lower for students 
from poorer families. In Honduras, half of the grade 6 
students from the poorest quintile scored at the low- 
est reading competency level in a 2013 regional Latin 
American assessment; only 7 percent of those from 
the richest quintile did (figure 3.3). 

Low-performing education systems are failing 
to meet their own curriculum standards (box 3.1). 
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Figure 3.1 Most grade 6 students in West and Central Africa are not sufficiently 
competent in reading or mathematics 


Competency levels from PASEC (2014), by subject, participating countries 
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Source: WDR 2018 team, using data from Programme d’Analyse des Systemes Educatifs de la Confemen (PASEC 2015) and World Bank’s World Development 
Indicators (World Bank 2016c). Data at http://bit.do/WDR2018-Fig_3-1. 


Note: For the PASEC reading exam, “not competent” refers to levels 0-2 in the original coding, “low competency” to level 3, and “high competency” to level 4. 
For the PASEC mathematics exam, “not competent” refers to levels 0-1 in the original coding, “low competency” to level 2, and “high competency” to level 3. 


Figure 3.2 Most grade 6 students in southern and East Africa are not sufficiently 
competent in mathematics, and several countries score poorly in reading as well 


Competency levels from SACMEQ (2007), by subject, participating countries 
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Source: WDR 2018 team, using data from Southern and Eastern Africa Consortium for Monitoring Educational Quality (SACMEQ 2007) and World Bank’s World 
Development Indicators (World Bank 2016c). Data at http://bit.do/WDR2018-Fig_ 3-2. 


Note: “Not competent” refers to levels 1-3 in the original SACMEQ coding, “low competency” to level 4, and “high competency” to levels 5-8. 
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Figure 3.3 Learning outcomes are substantially lower for poor children in 


Latin America 


Competency levels for TERCE (2013) grade 6, by subject, for students in poorest and richest socioeconomic quintiles, 


participating countries 
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Source: WDR 2018 team, using data from Third Regional Comparative and Explanatory Study (TERCE), 2013 (UNESCO 2013). Data at http://bit.do 


/WDR2018-Fig_3-3. 


Note: Socioeconomic quintiles are defined nationally. “Not competent” refers to level 1 in the original coding, “low competency” to levels 2-3, and “high 


competency” to level 4. 


While test scores on international assessments may 
be worryingly low, similar patterns emerge when 
assessing students against national standards. In 
urban Pakistan in 2015, only three-fifths of grade 3 
students could correctly perform a subtraction like 
54 - 25; in rural areas only two-fifths could.’ Across 51 
countries, only about half of women who completed 
grade 6 (but no higher) could read a single sentence. 
It is hard to imagine that these women are reaping 
the full potential economic or social returns from 
their years of schooling. 


These low learning levels are not an inevitable 
by-product of rapidly expanding education. Starting 
in the 1950s, the Republic of Korea focused on ensur- 
ing quality primary education for the vast majority of 
its population before shifting to a similar emphasis 
on secondary and ultimately higher education—with 
excellent learning results. The success of this strategy 
shows it is possible to ensure quality education even 
while rapidly expanding schooling. The key ingredi- 
ent is a persistent emphasis on the needs of the poor 
and disadvantaged.” The more recent experience 
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Box 3.1 Those who can’t read by the end of grade 2 struggle to catch up 


Illiteracy at the end of grade 2 has long-term consequences 
for two reasons. First, learning is cumulative. Education 
systems around the world expect students to acquire foun- 
dational skills such as reading by grades 1 or 2. By grade 3, 
students need to read to access their curriculum. Students 
who master these foundational skills early are at an 
advantage: skills from early grades are strongly positively 
associated with later school performance (see spotlight 
1).2 Children who cannot read by grade 3 fall behind and 
struggle to catch up, perhaps irreparably.° 


Source: WDR 2018 team. 


a. Glick and Sahn (2010). 

b. Muralidharan and Zieleniak (2013). 

c. Pritchett and Beatty (2012). 

d. Banerjee and Duflo (2012); Glewwe, Kremer, and Moulin (2009). 
e. Pritchett and Beatty (2012). 

f. Pritchett and Beatty (2012). 


of Vietnam reinforces that lesson; it, too, has main- 
tained education quality during rapid expansion by 
ensuring that disadvantaged students receive rela- 
tively equitable access to quality schooling." 

Even in middle-income countries, millions of 
students are lagging behind. In Brazil, internation- 
ally comparable assessments reveal that more than 
three-quarters of youth are reaching the age of 15 
without being able to perform at the lowest level of 
competence on the Programme for International 
Student Assessment (PISA) tests.” Similarly, a third of 
students in Paraguay have only a basic grasp of read- 
ing skills (“reading for meaning”) by grade 6.3 These 
students are therefore ill-equipped to participate 
in their economy and society.* These numbers also 
show interesting gender-based differences (box 3.2). 

However, some countries are doing better. 
Albania, Peru, and Portugal have made impressive 
progress in improving average student achievement 
relative to countries with similar incomes.* Latvia 
outperforms several countries in eastern Europe; 
Vietnam is a positive outlier in Southeast Asia. 
Although it is not always possible to clearly isolate 
the factors responsible for systemwide improve- 
ments in student learning, a policy focus on educa- 
tion quality appears to be important. For example, a 
major component of Vietnam's strong performance 
has been a convergence in school quality within the 
country. The share of schools that meet the national 
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Second, schools do not offer struggling students a chance 
to catch up. In many contexts, the pace of classroom instruc- 
tion is determined by the need to cover an overly ambitious 
curriculum rather than by the pace of student learning.‘ This 
means teachers have no choice but to ignore students who are 
falling behind. In India and Kenya, for example, the curriculum 
has been designed for the elite.‘ Teachers and textbooks focus 
on advanced topics that are of little use in helping struggling 
students. These students then fall even further behind— 
eventually so far that no learning whatsoever takes place.’ 


standards of quality has steadily increased over the 
last 25 years.’ 

Low student achievement in some middle-income 
countries relative to their economic competitors 
signals a failure to live up to their own expectations. 
According to the leading international assessments 
of literacy and numeracy, the average student in 
low-income countries performs worse than 95 percent 
of the students in Organisation for Economic Co-oper- 
ation and Development (OECD) countries—meaning 
that student would be singled out for remedial atten- 
tion in a class in a wealthier country.” In Colombia, 
Indonesia, and Peru, student performance at the 75th 
percentile on the PISA math test is barely above that 
at the 25th percentile of the OECD average. In Algeria, 
the Dominican Republic, Kosovo, and Tunisia, it is 
below the 25th percentile of the OECD average (figure 
3.4). The disparity between the average PISA score 
for Latin American countries and OECD countries is 
equivalent to over two full years of math education. 
Based on its rate of progress in average PISA scores 
from 2003 to 2015, it would take Tunisia over 180 years 
to reach the OECD average in math. This slow rate 
of improvement is especially problematic for middle- 
income countries trying to position themselves as 
important players in the global economic landscape. 

The mapping between schooling and workforce 
skills varies dramatically across countries. For exam- 
ple, the working-age population in Colombia reaches 


Box 3.2 Gender-based differences in learning depend on the subject 


Data from internationally benchmarked tests show that 
boys lag behind girls on test averages. In all but 6 of the 72 
countries and economies participating in the Programme 
for International Student Assessment (PISA), 15-year-old 
boys are more likely than girls of the same age to be low 
achievers on the composite average of the three subjects 


tested.? Whether on UNESCO’s Third Regional Comparative 
and Explanatory Study (TERCE), the Scholastic Aptitude 
Test (SAT) in the United States, or an array of national 
assessments, girls outperform boys on total test averages 
in most countries and economies.® 


Figure B3.2.1 Girls outperform boys on reading in all countries and economies, 
but boys typically do better in mathematics and science 
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margin in every country 
and economy 
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Source: WDR 2018 team, using data from Programme for International Student Assessment (PISA) collected in 2015 (OECD 2016a). Data at http://bit.do 
/WDR2018-Fig_B3-2-1. 


Note: Distribution based on data from 72 countries and economies that participated in PISA 2015. 


This higher average performance by girls masks important 
variations across subjects (figure B3.2.1). Girls consistently 
score higher in reading and writing; boys tend to perform bet- 
ter on mathematics and science in most countries and econo- 
mies where these tests—and others, such as the Programme 
d’Analyse des Systemes Educatifs de la Confemen (PASEC) 
and Southern and Eastern Africa Consortium for Monitoring 
Educational Quality (SACMEQ)—are administered.‘ 

Whereas girls and boys perform at equal levels in 
both mathematics and reading from kindergarten through 


Source: WDR 2018 team. 
a. OECD (2015). 


grade 2, boys score slightly better in mathematics and worse 
in reading starting in grade 3. This subject-specific gender 
gap continues to grow through secondary school. 

But the mathematics and science gap in favor of 
boys may be shrinking. Results from the 2015 Trends in 
International Mathematics and Science Study (TIMSS) 
assessment were much more mixed than for previous 
years: in about half the countries and economies tested, 
there were no statistically significant differences in gender 
performance in these subjects.° 


b. TERCE: UNESCO (2016); SAT: Fryer and Levitt (2010); national assessments: Bharadwaj and others (2015); Cornwell, Mustard, and Van Parys (2013); 


Uwezo (2014, 2015). 
c. Dickerson, McIntosh, and Valente (2015). 
d. Fryer and Levitt (2010); Singh (2016); UNESCO (2016). 
e. Mullis, Martin, and Loveless (2016). 
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Figure 3.4 Learning outcomes vary greatly across countries and economies— 
in several countries, the 75th percentile of PISA test takers performs below the 


25th percentile of the OECD average 


Performance of 25th, 50th, and 75th percentiles in 2015 PISA assessment, participating non-OECD economies and selected 


OECD economies 
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Source: WDR 2018 team, using data from Programme for International Student Assessment (PISA) collected in 2015 (OECD 2016a). Data at http://bit.do 


/WDR2018-Fig_3-4. 


Note: PISA 2015 defines baseline levels of proficiency at a score of 407 for reading and 420 for mathematics. China (B-S-J-G) = China (Beijing-Shanghai- 


Jiangsu-Guangdong). 


basic literacy proficiency by the lower secondary 
level, whereas the population of Bolivia needs six 
more years to attain even close to the same profi- 
ciency. Similarly, among 18- to 37-year-olds in Nigeria, 
only 19 percent of primary completers can read; in 
Tanzania, 80 percent can.” 

In some countries, large proportions of “educated” 
working adults are effectively low-skilled. Nearly 80 
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percent of Ghana's working-age population and over 60 
percent of Kenya's have just level 1 literacy or below— 
that is, their literacy proficiency is limited to under- 
standing basic texts, but they are not able to integrate, 
evaluate, or interpret information from a variety of text 
materials (figure 3.5).° This contrasts with the average 
for high-income countries, where only 15 percent of the 
working-age population is at level 1 or below. Individuals 


Figure 3.5 Middle-income countries underpin the development of higher-order cognitive, 
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meeting global development goals will be limited as 
long as the dimensions of this problem, its origins, 
and its implications remain unrecognized. 


Poor children learn the least, 
which hurts them the most 


Learning deficits are largest for poor people. In nearly 
all countries, students’ family backgrounds—includ- 
ing parental education, socioeconomic status, and 
conditions at home (such as access to books)—remain 
the largest predictors of learning outcomes (figure 
3.7).3 In France, the difference in science performance 
on the 2015 PISA between the richest and the poorest 
students was 115 points.** In Hungary, this difference 
was 202 points.” A 100-point difference in PISA scores 
is roughly equivalent to three years of schooling.” 

The learning gap between rich and poor students 
grows as students move to higher grades. In South 
Africa, children in grade 3 from the poorest households 
are three years’ worth of learning behind children from 
the richest households. This gap grows to four years’ 
worth of learning by grade 9.” In Andhra Pradesh, 
India, testing the same set of students each year reveals 
that this gap increases every year after grade 2.” 

Are learning gaps between rich and poor students 
simply a matter of household characteristics? Recent 


evidence suggests not. In Pakistan, rich-poor learning 
gaps are smaller than learning gaps between children 
from good and bad schools. In tests of English lan- 
guage, the difference in learning between a high-per- 
forming and a low-performing public school is 24 
times the difference between children from poor and 
nonpoor backgrounds, after controlling for observed 
child-level differences.”® Analysis of the 2009 PISA 
found that “the best performing school systems [in 
Canada; Finland; Hong Kong SAR, China; Japan; the 
Republic of Korea; and Shanghai, China] manage to 
provide high-quality education to all students” rather 
than only to students from privileged groups. 


What is causing the learning 
crisis? 


A simple framework can be used to organize the prox- 
imate (or immediate) determinants of the learning 
crisis." Proximate determinants are those most 
directly linked to learning outcomes and are them- 
selves the result of deeper determinants. The frame- 
work identifies four proximate determinants: learner 
preparation, teacher skills and motivation, the 
availability of relevant inputs, and the school man- 
agement and governance that bring these together 
(figure 3.8). This approach provides a simple tool for 


Figure 3.7 Family socioeconomic status significantly affects students’ average 


PISA scores 


Distribution of scores on PISA 2015 across 69 countries (pooled) for students from the bottom and top quintiles of 


socioeconomic status, by subject 
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Source: WDR 2018 team, using data from Programme for International Student Assessment (PISA) collected in 2015 (OECD 2016a). Data at http://bit.do 


/WDR2018-Fig_3-7. 


Note: A year of education is assumed to equal roughly 33 points on the PISA exam in this analysis, and the gap is calculated as the difference between modal 


averages of the top and bottom quintiles for each subject. 
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systematically integrating a wide range of actorsand Figure 3.8 The proximate determinants of learning 
factors in determining the learning process. 


Children do not arrive ready to learn 
Children from disadvantaged backgrounds tend to 
exhibit learning deficits years before they start school; 
these deficits leave them ill-prepared for the demands 
of formal education. Acquiring foundational skills in 
early childhood is essential for learning, and robust 
early childhood development can launch children 
on higher learning trajectories (see spotlight 1). 
But for children from disadvantaged backgrounds, 
adversities begin to accumulate before they are born. 
Chronic malnutrition, illness, the cumulative effects 
of material deprivation, low parental support, and the 
unpredictable, chaotic, or violent environments that 
can be associated with poverty all undermine early 
childhood development learning (see spotlight 2).” 
Steep socioeconomic gradients in cognitive, lin- 
guistic, and early literacy development help determine 
school outcomes. Language and cognitive gaps are evi- 
dent before a child’s first birthday.* In a wide range of 
countries, from the Democratic Republic of Congo to 
the United States, children from poor households lag 
behind their more affluent peers by age 3, with gaps 
widening as children age (figure 3.9). Gaps in early —_ Source: WDR 2018 team. 


Figure 3.9 Socioeconomic gaps in cognitive achievement grow with age—even in 
preschool years 


Percentage of children (ages 3-5) who can recognize 10 letters of the alphabet, by wealth quintile, selected countries 
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Source: WDR 2018 team, using data from Multiple Indicator Cluster Surveys (http://mics.unicef.org). Data are for 2010 for the Central African Republic, 2010-11 for Kazakhstan, 
and 2012 for Tunisia. Data at http://bit.do/WDR2018-Fig_ 3-9. 
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language and cognitive abilities are very alarming 
because they are important predictors of performance 
throughout school and into early adulthood.*s 

Poor foundations are evident in other crucial 
determinants of school performance such as socio- 
emotional and executive functions. Socioemotional 
skills include teamwork, motivation, and confidence, 
while executive functions (which rely on both socio- 
emotional and cognitive skills) include planning, 
organizing, implementing, and multitasking, among 
others. The evidence on these developmental 
dimensions is more limited because of measure- 
ment difficulties. Still, gaps in working memory and 
sustained attention (executive functions) for poorer 
children are evident starting at 6 months of age and 
through the preschool years.’ Even in Madagascar, a 
very poor country, wealth gradients are apparent after 
accounting for maternal education and household 
inputs—gaps that widen with age.* There are wealth 
gradients of socioemotional development as well. 
One in every three children between the ages of 3 and 
4 ina range of countries fails to meet basic milestones 
in socioemotional development, such as the ability to 
control aggressive behaviors, avoid distractions, and 
get along with peers. 

Because learning is cumulative and skills beget 
skills (see spotlight 1), the cognitive and socioemo- 
tional developmental gaps that emerge at young ages 
worsen over time. So do learning gaps: poor develop- 
mental foundations and lower preschool skills mean 
disadvantaged children arrive at school late and unpre- 
pared to benefit fully from learning opportunities. As 
these children get older, it becomes harder and harder 
for them to break out of lower learning trajectories. 


Teachers often lack the needed skills and 
motivation 

Teachers are the most important determinant of stu- 
dent learning. Estimates suggest that in the United 
States, students with great teachers advance 1.5 grade 


levels or more over a single school year, whereas 
those with a poor teacher advance just 0.5 grade 
levels.4° Across kindergartens in Ecuador, differences 
in learning outcomes for language, math, and execu- 
tive function are strongly associated with differences 
in teacher behaviors and practices.*' No other school- 
level factor has an impact nearly this large on student 
achievement.” 

But high-quality teachers are in short supply 
in low-income countries.# Less than 25 percent of 
Sub-Saharan Africans currently complete secondary 
education.** Thus there are simply not enough qual- 
ified candidates to meet the growing demand for 
teachers. In some countries, teacher training colleges 
have had to lower their entry requirements to ensure 
an adequate supply of teachers. These colleges also 
push trainees through the programs in two years or 
less to try to fill the need for primary school teachers. 
In Latin America, there is evidence that candidates 
entering the teaching profession are academically 
weaker than the pool of higher education students. 
Fifteen-year-olds who identified themselves as inter- 
ested in a teaching career had much lower PISA math 
scores than students interested in engineering in 
every country in the region, and they scored below 
the national average in nearly all countries.*° Teachers 
may also not always have the necessary pedagogical 
skills; classroom observations in six countries in 
Sub-Saharan Africa found that few public primary 
school teachers are able to assess children’s abilities 
and evaluate students’ progress, and few engage in the 
practices typically associated with good teaching.” 

As a result, teachers often do not have sufficient 
mastery of concepts they are expected to teach. In 
several Sub-Saharan countries, the average teacher 
does not perform much better on reading tests than 
the highest-performing grade 6 students.** Across six 
countries in the region, 40 percent of primary school 
teachers are not as knowledgeable as their students 
should be (table 3.1).*? In Bihar, India, only 10.5 percent 


Table 3.1 Few teachers reach minimum thresholds of performance on knowledge assessments 


Percentage of teachers who score at least 80 percent on a test of grade 4 material 


Kenya |Mozambique) Nigeria | Tanzania | Togo | Uganda 
Subject Average (2012) (2014) (2013)2 (2014) (2013) (2013) 
Equivalent to student language curriculum 61 66 77 24 Al 54 90 
Equivalent to student mathematics curriculum 56 82 26 31 62 24 55 


Source: Bold and others (2017). 
a. Data based on four states in Nigeria. 
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Figure 3.10 A lot of official teaching time is lost 


Percentage of time officially allocated to schooling that a teacher is scheduled to teach, is present in the classroom, and is 
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Sources: WDR 2018 team, using data from Abadzi (2009): Brazil (Pernambuco state), Ghana, Morocco, and Tunisia; Benveniste, Marshall, and Araujo (2008): 
Cambodia; Benveniste, Marshall, and Santibafiez (2007): Lao People’s Democratic Republic; Millot and Lane (2002): Arab Republic of Egypt, Lebanon, and 
Republic of Yemen; World Bank (2016a): Madagascar; World Bank (2016b): Zambia; World Bank’s Service Delivery Indicators, 2012-13 (http://www.worldbank 
.org/sdi): Kenya, Mozambique, Nigeria, Senegal, Tanzania, Togo, and Uganda. Data at http://bit.do/WDR2018-Fig_ 3-10. 


Note: For Brazil, Cambodia, Ghana, Lao PDR, Senegal, Tanzania, and Tunisia, data include public schools. For all other countries, data include both public and 


private schools. 


of tested public school teachers are able to solve a 
three-digit by one-digit division problem and show 
the steps correctly. 

Many developing countries suffer significant 
losses of instructional time (figure 3.10). Unan- 
nounced visits to primary schools in six countries 
found that in public schools, on average, about one 
teacher in five was absent on a typical school day.* 
Even when teachers are present in school, they may 
not be teaching. In seven Sub-Saharan countries, 
students receive only about two and a half hours of 
teaching a day—less than half the scheduled time.” 
Teacher absenteeism and low time on task when in 
class—combined with other factors such as informal 
school closures or student absenteeism—mean that 
only about one-third of the total instructional time 
is used in Ethiopia, Ghana, and Guatemala. Even 
in middle-income countries in Latin America, about 
20 percent of potential instructional time is lost—the 
equivalent of one less day of instruction a week.* 
There are many reasons for this loss of instructional 
time, including poor training and other demands on 
teachers, and some teachers may perceive it as justi- 
fied (box 3.3). But whatever the cause, lost teaching 
time reduces student learning. 


This problem is particularly concerning because 
the bulk of national education budgets goes to teacher 
salaries. In Latin America and the Caribbean, teacher 
salaries absorb nearly 4 percent of the regional 
gross domestic product (GDP). Staff compensation 
accounts for 80 percent of public spending on edu- 
cation in some countries (figure 3.11). If one in five 
government primary school teachers is absent from 
school, developing countries are wasting consider- 
able resources. 

According to recent data on 1,300 villages in 
India, nearly 24 percent of teachers were absent 
during unannounced visits, at an associated fiscal 
cost of US$1.5 billion a year.5° Reducing absenteeism 
in these schools would be over 10 times more cost- 
effective at increasing student-teacher contact time 
than hiring additional teachers. 


School management skills are low 

The effective management of schools relies on capac- 
ity and autonomy for decision making at the school 
level, which are often lacking. Higher management 
quality’” and school leadership are associated with 
better education outcomes.* Yet in many developing 
countries effective school management is missing 
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Box 3.3 Teachers may perceive low effort as being justified 


Teachers across a variety of countries justify certain types of service delivery gaps. Consider teacher perceptions of two basic aspects of 
teacher performance, based on teacher surveys administered in 2017 (figure B3.3.1). 


Figure B3.3.1 Teachers’ beliefs about their effort and its effects 


a. Teachers often consider their b. Teachers often feel they have little 
absence acceptable impact on poor children’s learning 
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Note: Responses are not mutually exclusive. Data are from public schools, except for Senegal (private and public schools) and Uganda (private schools). 


Source: Sabarwal and Abu-Jawdeh (2017). Data at http://bit.do/WDR2018-Fig_B3-3-1. 


Figure 3.11 Staff compensation consumes the largest share of resources available 
for public education 


Staff compensation as percentage of total expenditure on public education, by country and income group 
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Source: WDR 2018 team, using data from UNESCO Institute for Statistics (UIS 2017). Data at http://bit.do/WDR2018-Fig_3-11. 


Note: Figure includes all countries with populations of over 500,000 for which spending data are available at the primary or secondary levels. Latest data available. 
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Figure 3.12 Management capacity 
is low in schools in low- and middle- 
income countries 


Distribution of management scores by sector, participating 
countries 
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Sources: Bloom and others (2014, 2015); Lemos and Scur (2016), with 
updates. Data at http://bit.do/WDR2018-Fig_ 3-12. 


Note: The underlying distributions for the education data are shown as 
bars; for both sectors, the smoothed distributions are shown as curves. 
The indexes are constructed from the nine items that are comparable 
across sectors. Data on manufacturing are not available for Haiti. 
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(figure 3.12). Moreover, lack of autonomy prevents 
head teachers or school management committees 
from improving service delivery.5? Even when the req- 
uisite autonomy exists, it may not be enough. Schools 
may choose not to exercise the provided authority or 
may lack the will and capacity to do so.°° For exam- 
ple, a survey in Uganda found that only 57 percent of 
school management committee members reported 
having read their committee’s handbook.” In Uttar 
Pradesh, India, a quarter of village education commit- 
tee members surveyed did not even know they were 
members.” 


School inputs have not kept pace 

In many developing countries, the expansion of 
inputs has not kept pace with the explosion in enroll- 
ments. Governments have built classrooms and 
recruited teachers at unprecedented levels. But these 
efforts may not have kept up with rising enrollments, 
leading to a decline in per capita input availability. In 
Malawi between 2008 and 2015, as the gross enroll- 
ment rate in primary schools increased from 131 to 
146 percent, the average number of students per class 
increased from 85 to 126.°3 Uganda introduced univer- 
sal primary education in 1997. The 68 percent increase 
in primary school enrollment that followed increased 
the student-teacher ratio from 38:1 in 1996 to 80:1 in 
1997 and the student-to-classroom ratio from 68:1 in 
1996 to 105:1 in 1997. 


REX 


The learning crisis is real, but too often education 
systems operate as if it is not. Many policy makers 
do not realize how low learning levels are. Others do 
not acknowledge them or simply equate low learning 
with low resources. Still, there are reasons for opti- 
mism. First, learning is increasingly in the spotlight. 
Second, learning metrics are generating irrefutable 
evidence of the learning crisis, thereby creating 
pressure for action (see chapter 4). Third, promising 
new insights on how to tackle the crisis are becoming 
available (see parts III and IV of this Report). 
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UNESCO (2015). 

Filmer, Hasan, and Pritchett (2006). 

OECD (2016a). 

Dang and Glewwe (2017). 

Crouch and Gove (2011), which is based on the Progress 
in International Reading Literacy Study (PIRLS) and 
Trends in International Mathematics and Science Study 
(TIMSS). 

Kaffenberger and Pritchett (2017). 

The literacy skills proficiency construct covers a range of 
skills from the decoding of written words and sentences 
to the comprehension, interpretation, and evaluation of 
complex texts. It takes into account workplace, personal, 
society, and community. To facilitate the interpretation 
of individual scores, described proficiency scales are 
available to articulate the requisite skills and knowledge 
needed to perform specific tasks along a 500-point scale. 
The tasks move progressively in complexity from level o 
to level 5. See ETS (2014) and OECD (2016c). 

Desjardins and Rubenson (2011); OECD (2016b). 

di Gropello (2011); Fouarge, Schils, and de Grip (2013); 
Heckman (2000); O’Connell and Jungblut (2008); Wind- 
isch (2015). 

WDR 2018 team estimates using literacy proficiency asa 
proxy for foundational skills. 

Bruns and Luque (2015); Filmer and Pritchett (1999). 
OECD (2016a). 

OECD (2016a). 

OECD (2016a). 

Spaull and Kotze (2015). 

Muralidharan and Zieleniak (2013). 

Das, Pandey, and Zajonc (2006). 

OECD (2010). 

Hanushek (1979). 

Lupien and others (2000); McCoy and others (2016); 
Walker and others (2007). 

Rubio-Codina and others (2015). 

Countries where these outcomes have been evaluated 
include Cambodia, Chile, the Democratic Republic of 
Congo, Ethiopia, India, Madagascar, Mozambique, Nige- 
ria, Sierra Leone, Togo, the United States, and Vietnam. 
Fernald, Marchman, and Weisleder (2013). 

Galasso, Weber, and Fernald (2017); McCoy and others 
(2016). 

Fernald and others (2012); Lipina and others (2005); 
Noble, Norman, and Farah (2005). 

Galasso, Weber, and Fernald (2017). 

McCoy and others (2016). 

Hanushek (1992); Rockoff (2004). 

Araujo and others (2016). 

Bruns and Luque (2015). 

UIS (2006). 

UNESCO Institute for Statistics, 2016 (UIS 2017). 
Mulkeen (2010). 

Bruns and Luque (2015). 

Bold and others (2017). 

UIS (2006). 

Bold and others (2017). 

Sinha, Banerji, and Wadhwa (2016). 

Chaudhury and others (2006). 


| World Development Report 2018 


52. Bold and others (2017). 

53. Informal school closures may stem from strikes, inclem- 
ent weather, or ad hoc holidays. For Ethiopia and Guate- 
mala see EQUIP2 (2010); for Ghana, see Abadzi (2009). 

54. Bruns and Luque (2015). 

55. Bruns and Luque (2015). 

56. Muralidharan and others (2017). 

57. Bloom and others (2015); Fryer (2017). 

58. Robinson, Lloyd, and Rowe (2008). 

59. Bruns, Filmer, and Patrinos (2011); Orazem, Glewwe, and 
Patrinos (2007). 

60. King, Ozler, and Rawlings (1999). 

61. Najjumba, Habyarimana, and Bunjo (2013). 

62. Banerjee and others (2010). 

63. MoEST (2008, 2015); World Bank (2016c). Gross enroll- 
ment includes students whose age exceeds the official 
age group for a particular education level, so the rate 
may exceed 100 percent. 

64. Bentaouet-Kattan (2006). 

65. The World Bank's 2020 sector strategy and the U.K. 
Department for International Development's 2010 strat- 
egy are learning for all; the U.S. Agency for International 
Development’s strategy is opportunity through learn- 
ing; and AusAID is also adopting learning goals. 
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SPOTLIGHT 2 


Poverty hinders biological development 
and undermines learning 


Life outcomes are hugely influenced by a child’s 
development during the early years. Biological sys- 
tems develop sequentially and cumulatively, so what 
happens early in life lays the foundation for future 
development. Between the time of gestation and a 
child’s sixth birthday, the brain matures faster than 
at any other time of life. This period is also when the 
brain, along with its supporting systems, is most mal- 
leable. This malleability is a double-edged sword: high 
susceptibility to early environmental influence serves 
as both a window of opportunity and a source of vul- 
nerability, because it means experiences can shape 
how development unfolds.' The environment children 
grow up in is a key determinant of their developmen- 
tal trajectories toward outcomes later in life. 
Growing up in poverty usually exposes children 
to many risk factors. In poor households, low levels 
of parental education exacerbate material deprivation 
by undermining investment choices for children’s 
development, in terms of how parents use both their 
financial resources and their time. Moreover, parents’ 
limited mental bandwidth, as well as the psycholog- 
ical stress imposed by poverty (including working 
many hours in often precarious conditions to make 
ends meet), further undermine the time, energy, 
and care they can give their children. For the child, 
this often results in poor physical inputs starting in 
the womb, such as insufficient nutrition or extreme 
deprivation. It also results in poor social inputs, such 
as insufficient stimulation (not being held, responded 
to, talked to, or played with), neglect, abuse, exposure 
to violence, displacement, or maternal depression. 
Acute adversity during the early years becomes 
embedded in children’s bodies. In the face of depri- 
vation, disease, or noxious environments, developing 
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systems direct resources toward survival rather than 
promoting growth—physical or mental. For example, 
one in four children worldwide is stunted due to 
chronic malnutrition. Stunting between gestation and 
a child’s second birthday is associated with late school 
enrollment, lower cognition, poorer executive func- 
tion, and less school attainment. Some catch-up is 
possible after a child's second birthday, but previously 
stunted bodies remain highly sensitive to disease 
and infection. Children born with low birth weight 
(suggesting fetal undernutrition) are at higher risk of 
chronic adult diseases such as hypertension, diabetes, 
obesity, and coronary artery disease (“metabolic syn- 
drome”). The extent to which the associated earlier 
cognitive impairment can be reversed is uncertain. 
Exposure to multiple risk factors without the buff- 
ering support of available, well-informed, responsive 
caregivers can cause toxic stress.° Stress triggers the 
flight-or-fight response, an intense physiological 
reaction that puts the body in a state of alertness to 
deal with potential threats. Continual activation of the 
flight-or-fight response in early life endangers develop- 
ing systems, because the brain focuses on addressing 
the perceived danger to the detriment of further devel- 
opment of biological systems not essential for survival. 
Toxic stress in the early years can undermine 
lifelong health, learning, and behavior. Hormones 
associated with the flight-or-fight response, such as 
cortisol, can inhibit physical growth as well as weaken 
immune systems and metabolic regulatory mecha- 
nisms, all of which permanently increase an individ- 
ual’s susceptibility to illness. Moreover, toxic stress 
during the early years can impair the development 
of neural connections in parts of the brain that are 
critical for learning—such as those associated with 


Figure S2.1 Severe deprivation affects 
brain structure and function from early 
in life 
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@ Never stunted: n = 18 (9 boys, 9 girls); 
age 73 days + 8 days 

& Stunted growth: n = 9 (6 boys, 3 girls); 
age 82 days + 11 days 


Source: WDR 2018 team, using data from Nelson and others (2017). Data at 
http://bit.do/WDR2018-Fig_S2-1. 


Note: Data obtained from infants 2-3 months old in Dhaka, Bangladesh, using 
magnetic resonance imaging (MRI). Graph depicts two groups of infants: 18 
not stunted (not malnourished) and 9 stunted (malnourished). Graph shows 
(from left to right) total amount of brain volume; total amount of gray matter, 
where most neural computations are performed; total amount of white 
matter, which transmits electrical signals between gray matter and affects 
brain function and learning (that is, the information pathways of the brain); 
and cerebral spinal fluid, which protects the brain and spinal cord from injury 
and infection and is generally involved in many aspects of brain health. 


socioemotional outcomes and executive functions, 
the biological foundations of learning.’ 

Severe deprivation, along with the associated 
stress, can impair healthy brain development.® Neuro- 
imaging data from studies in Bangladesh, The Gam- 
bia, Romania, the United Kingdom, and the United 
States reveal differences in brain development (both 
structural and functional) linked to socioeconomic 
status. The studies confirm reduced brain connec- 
tivity as well as smaller brain volumes in areas asso- 
ciated with language, memory, executive function, 
and decision-making skills, on the one hand (figure 
S2.1),? and high activation of regions associated with 
emotional reactivity, on the other.’° Such connectivity 
patterns and associated biological maladaptations are 
very difficult to reverse. 

These biologically embedded responses lead 
to worse developmental trajectories and impaired 
learning, hurting foundational skills from the earliest 
stages of life. Because early childhood development 
outcomes are interdependent (see spotlight 1), subpar 
development in any one dimension is likely to affect 
the others. Children with stunted bodies and brains 
attempting to compensate for developmental gaps 
face daunting odds as they start formal schooling 
because of the sequential nature of development, 
coupled with the sharp decrease in brain malleability 
after a child’s sixth birthday. Investments in early 
childhood development enable the normal, timely 
development of biological systems, shaping children’s 
long-term ability to learn (figure S2.2). Well-designed 


Figure S2.2 Risk and protective factors affect developmental trajectories 
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Adulthood 


early childhood interventions that increase poor 
children’s access to protective factors (nutrition, stim- 
ulation, care, protection from stress) can enable those 


Notes 


1. Knudsen (2004). 

2. Mullainathan and Shafir (2013). 

3. UNICEF, WHO, and World Bank (2016). Stunting is 
defined as a height-for-age z-score of less than two stan- 
dard deviations below the median of a healthy reference 
population. 

. Black and others (2013); Christian and others (2014). 

. Center on the Developing Child (2016). 

. McEwen (2007). 

. Evans and Kim (2013); McCoy and Raver (2014). 

. Center on the Developing Child (2016). 

. Bright Project (http:/www.globalfnirs.org/the-bright 
-project); Nelson and others (2017); Noble and others 
(2015); Vanderwert and others (2010). 

10. Pavlakis and others (2015). 
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To take learning 
seriously, start by 
measuring it 


“The results tell us about the fact of the drop in education quality, after releasing 
the 2015 results of the Trends in International Mathematics and Science Study. ... 
We cannot ignore what is happening to our education, and we cannot afford the 


repercussions of not reforming it.” 


QUEEN RANIA OF JORDAN, FACEBOOK POST, DECEMBER 2016 


Why does the learning crisis persist? How can chil- 
dren attend school for years but remain functionally 
illiterate? Why don’t the people in education systems 
fix this? One big reason is that, for many, the learning 
crisis is invisible. Education systems have little sys- 
tematic information on who is learning and who is 
not. As a result, it is impossible to generate an impetus 
for action—let alone a plan. 

To tackle the crisis, it is necessary—though not 
enough—to measure learning. But learning metrics 
must facilitate action, be adapted to country needs, 
and consist of a range of tools to meet the needs of the 
system, including at the classroom level. 


The learning crisis is often 
hidden—but measurement 
makes it visible 


‘Almost no low-income countries have 

standardized (equated over time) national assessment 
systems to track learning and provide a feedback 
mechanism to national education policies and 
programs” (Birdsall, Bruns, and Madan 2016, 2). 


Education systems routinely report on enrollment— 
but not on learning. Because learning is missing from 


official education management data, it is missing 
from the agendas of politicians and bureaucrats. This 
is evident in how politicians often talk about edu- 
cation only in terms of inputs—number of schools, 
number of teachers, teacher salaries, school grants— 
but rarely in terms of actual learning. Lack of data 
on learning means that governments can ignore or 
obscure the poor quality of education, especially for 
disadvantaged groups. 

Without objective information on learning, par- 
ents may be unaware of the poor quality of education. 
This prevents them from demanding better services 
from schools and governments. In Kenya, one study 
found that less than half of the children in grade 
4 could pass basic proficiency tests in literacy or 
numeracy, yet more than two-thirds of adults were 
broadly satisfied with the government's performance 
in education. The realization that learning outcomes 
are poor may come only when children face poor labor 
market prospects, but by then it is too late. If parents 
have no real information on how much (or little) their 
children are learning, how can they hold schools or 
governments accountable? 

Without clear information on what students do 
not know, how can schools improve instruction? 
Teachers may find it hard to judge to what extent 
students understand what is being taught. This is 
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particularly true in low-income countries, where 
teachers face large classrooms that mix students of 
very different abilities. For example, a study from 
Delhi, India, found that the same grade may contain 
students whose achievement level spans the equiva- 
lent of five to six grades.” In such contexts, learning 
measures provide teachers with timely feedback 
about which students may need additional support. 
More broadly, these measures provide school man- 
agement with information about which areas need 
attention to improve instruction. If the information 
is shared with parents or students, it can help them 
direct their own efforts toward improving learning. 
Yet concerted action is often derailed by concerns 
about the possible pitfalls of learning metrics. These 
metrics generate much debate on, for example, the 
outsize impacts of international assessments on 
local policy, the limited use of national assessments 
for improving classroom practice, or the potential 
gaming of high-stakes testing? But measurement of 
learning is not shorthand for international testing 
such as the Programme for International Student 
Assessment (PISA) or for the high-stakes account- 
ability approach implemented through the U.S. No 
Child Left Behind policy. Instead, the term covers a 
range of assessments, including formative classroom 
assessments (box 4.1). Even in this form, measures 
of learning provide information on only some of the 
skills students acquire as they develop (see spotlight 
3 on multidimensionality of skills). Thus metrics are 


complements of, not substitutes for, careful, con- 
text-specific analysis to determine how to improve 
learning,* 


Measures for learning guide 
action 


Testing in Rio de Janeiro, Brazil, happens at 

two levels. First, every two years all students in 
grades 5 and 9 take a national test (the Prova Brasil) 
designed to assess public education. Second, students 
are tested at the end of each two-month curriculum 
block. These tests, given by municipal education 
departments, aim to provide quick feedback to 
teachers and principals, allowing schools and the 
broader system to provide more support to struggling 
students (Elwick and McAleavy 2015). 


Identifying learning gaps in the classroom is the first 
step toward resolving them. In environments of low 
learning, there is often a gap between the level of stu- 
dents and the level at which classes are being taught.5 
This might be because teachers are unaware of stu- 
dents’ levels. Fostering a culture of classroom-based 
assessments can address this problem. In Singapore, 
students are given screening tests at the start of grade 
1, which helps teachers identify those who require 
additional instruction to learn to read.° 

Learning metrics help highlight where support 
is most needed. School districts and schools are then 


Box 4.1 Good measures of learning illuminate all parts of the education 


system 


Formative classroom assessments facilitate instruction 
by providing real-time feedback to support teaching and 
learning. This feedback allows teachers to identify strug- 
gling students, thereby enabling them to adjust instruction 
to meet the learning needs of different students. Classroom 
assessments also generate valuable feedback for students 
and parents. 

National assessments provide information on the overall 
education system by highlighting achievements along with 
challenges, such as inequalities. They are useful for educa- 
tion management, policy, and reform. 

National examinations certify student achievement, 
with a focus on transparently selecting students for more 


Source: WDR 2018 team. 
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advanced placements in the education system or job 
market. Because of their role in determining labor market 
outcomes, these examinations are high-stakes for students. 
They significantly affect what is taught and how, and they 
are critical for managing the flow of students through the 
system. 

International assessments benchmark student perfor- 
mance by evaluating education systems across countries 
and over time using representative samples of children. 
There has also been a steady increase in the use of citizen- 
led assessments. These can be important for fostering 
public awareness, showing what is possible, advocating for 
change, and informing research. 


better able to target resources to improve service deliv- 
ery. In Brazil, national assessments have been widely 
adopted by states and municipalities to strengthen 
school performance.’ Learning metrics have also 
guided big-banner education reforms. In Chile, PISA’s 
reading framework guided national curriculum 
reform.’ Similarly, findings from the Southern and 
Eastern Africa Consortium for Monitoring Educa- 
tional Quality (SACMEQ) I, 1995-99, underpinned a 
review of Mauritius’s education master plan.’ In some 
cases, learning metrics have been instrumental in 
making education reform data-driven. In Germany, 
lower than expected results—especially for students 
from poorer backgrounds—on the 2000 PISA led to the 
development of more support for disadvantaged stu- 
dents, especially those from immigrant backgrounds.” 

For learning metrics to guide action effectively, 
they need to be used as a range of tools to serve 
different needs, from classroom practice to system 
management. Measures of learning come in various 
forms, with different measures serving different pur- 
poses for different actors. These range from simple 
oral questions posed by a teacher to national assess- 
ments that help policy makers prioritize action (box 
4.1). In well-functioning systems, these different tools 
complement one another to form a coherent whole.” 

Policy makers should rely on a broad range of 
information instead of any one measure. When a 
single metric becomes the sole basis for big policy 
triggers, the corresponding stakes may become 
dangerously high. A striking example is the U.S. No 
Child Left Behind policy enacted in 2001. This policy 
had strong negative repercussions for schools that 
performed poorly on annual statewide standardized 
tests. Though the policy led some poorly performing 
schools to improve, it also generated various unde- 
sirable strategic responses by teachers and school 
administrators.2 These included reclassifying stu- 
dents as requiring special education, exempting 
certain students from testing, reallocating resources 
to students at the margin of passing, and suspending 
low-scoring students near test dates.¥ Even in the 
case of PISA, some studies have suggested that the 
performance in some places—Argentina, Malaysia, 
Vietnam, Shanghai (China)—could be tied in part to 
(perhaps inadvertent) “selective samples” that may 
exclude some poorly performing schools or students.“* 

Education systems also routinely underuse the 
information generated by learning metrics—making 
for a lot of measurement that leads to little action.’ 
Often, findings are simply not communicated in a 
timely way to relevant audiences. There may also 
be credibility issues. If teachers or schools do not feel 


heard or acknowledged in a national assessment pro- 
cess, they will likely reject its findings. For example, 
teachers are more likely to resist quantitative forms 
of evaluation when metrics do not take into account 
context.” This is particularly the case for measures of 
learning disseminated as rankings, which are suscep- 
tible to being taken out of context. In some education 
systems, such friction is heightened by the use of 
technology, which raises questions about privacy 
and transparency. Approaches using technology also 
involve limited social interaction, which is associated 
with less impact. 

For measurement to guide action, it must be 
actionable. It also needs to be available to stakehold- 
ers. At the design stage, stakeholders have to ask 
themselves how learning data will be used. In Chile, 
all students in grades 4 and 8 take the Sistema de 
Medicion de la Calidad de la Educacién (SIMCE) each 
year. After the test identifies the 900 schools scoring 
in the lowest 10 percent on the tests in their province, 
these schools receive special resources. The data, then, 
are clearly linked to action. Many assessment systems 
measure outcomes too infrequently or too broadly to 
be of practical use. The most recent publicly available 
data from the SACMEQ are for 2007. Another con- 
straint is the lag between when data are collected and 
when they are made available, as well as how data are 
made available. Many ministries produce only hard 
copies of summary reports, which make them diffi- 
cult to use. 


Measures of learning spur 
action 


“Shock as 60 [Percent] of Tanzania Students 
Fail National Exam” (East African, 2013) 


In the United States since 2001, information on 
different schools’ performance on standardized 
tests has notably increased turnout in local 
school board elections (Holbein 2016). 


Measures of learning motivate action through three 
channels: 


* Participation. Learning outcomes are often far 
worse than stakeholders realize. In Uganda, nearly 
three-quarters of parents said they were satisfied 
with the quality of education—yet only a quarter 
of grade 4 students could pass a math test based on 
grade 2 questions.”® By documenting service deliv- 
ery shortfalls, learning metrics can motivate par- 
ents to hold their schools accountable for learning. 
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In such contexts, learning metrics can correct infor- 
mation failures, which are especially severe for the 
poor. This correction can in turn rebalance the rela- 
tionship between users and providers. This channel 
operates via the direct or short route of accountabil- 
ity running from parents directly to schools. 

* Choice. Providing parents with hard evidence 
about learning outcomes at alternative schools can 
encourage schools to improve learning by increas- 
ing competitive pressures. When parents have 
objective information about learning outcomes 
across schools, they can punish poorly performing 
schools by “voting with their feet.” Public schools 
care about such outcomes because their resources 
are often tied to the number of students they 
enroll.” But this channel may also disproportion- 
ately penalize schools that serve poor children. 

* Voice. Learning metrics can facilitate lobbying for 
reform by providing information on what needs 
fixing. Lack of reliable metrics, by contrast, under- 
mines accountability for results.” This channel 
operates via the long route of accountability, where 
learning metrics may help citizens use the political 
process to hold politicians accountable for learning. 


That said, the links from measurement to action 
are neither automatic nor straightforward. India’s 
citizen-led assessment, the Annual Status of Educa- 
tion Report (ASER), has documented low proficiency 
scores since it was introduced in 2004. However, clear 
or sustained improvements are not yet visible for the 
country as a whole.” At the same time, some Indian 
states have shown significant improvements in grade 
3 reading levels between ASER 2010 and 2016.* This 
shows that it is not just the information but action 
that matters. For learning to improve, not only do 
learning assessments need to be available, but also 
someone needs to act on them. In fact, an evaluation 
of the impact of citizen-led assessments in Kenya 
finds that for information on learning to spur action, 
those who receive the information must understand 
it, see it as actionable, care about the topic, and believe 
that their actions will improve outcomes.” 

Political pressures may limit the extent to which 
measures of learning spur positive action. Where 
education quality is low, politicians have an incentive 
to hide or obscure learning outcomes.” They may also 
try to evade blame for poor performance by setting 
low standards, trying to limit year-to-year compara- 
bility, or restricting access to outcome information.” 
For example, Argentina amended its standardized 
test so that year-to-year comparisons are not possible, 
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decreased the frequency with which the test is admin- 
istered, and delayed the publication of results by two 
years to obscure the poor performance of students.” 
Teachers, too, might resist learning assessments to 
minimize opportunities for blame.”? In Chile, teacher 
training institutions have shown resistance to the 
national assessment.*° Assessments are also political 
because they can affect the flow of resources or pres- 
tige in an education system—as in the United States 
under the No Child Left Behind policy." Underlying 
politics can make student assessment systems partic- 
ularly hard to reform (see part IV of this Report). 

When does measurement mobilize citizens to 
demand accountability for learning? Because of lim- 
ited attention, information is often ignored, especially 
if it is complex or provides unwelcome news. There- 
fore, for measurement to spur action, information 
must be available in an easily digestible way. But this 
in itself may not be enough. Learning metrics can gal- 
vanize communities to hold their schools accountable 
for learning only when collective action problems are 
resolved.# A participatory approach—where schools 
and communities have a say in what type of “learning 
metrics” are generated at the school level—may be 
likely to work better here. In addition, for citizens 
to be able to act on information, fear of reprisals must 
be low. Finally, for citizens to act in behalf of change, 
they must believe that their own individual actions 
can make a difference.* 

Efforts country performance 
through international or regional assessments have 
in some cases galvanized action because interna- 
tional comparisons make learning politically salient. 
Release of the Trends in International Mathematics 
and Science Study (TIMSS) or PISA rankings often 
triggers intense media interest, inserting learning 
into political and economic debates.** This increase in 
interest often generates momentum for government 
action—an effect known as “PISA shock’—thereby 
unleashing targeted reforms. About half the countries 
participating in the PISA assessments under the aegis 
of the Organisation for Economic Co-operation and 
Development (OECD) have launched reforms because 
of the results” Learning assessments also spur 
action by making learning a tangible goal. Whereas 
the United Nations’ Millennium Development Goals 
(MDGs), which inspired efforts by governments and 
donors, focused on enrollment, the current Sustain- 
able Development Goals (SDGs) place greater empha- 
sis on learning.** The success of the SDGs will depend 
on countries’ ability to turn rhetoric into action by 
tracking learning. 


to benchmark 


Choose learning metrics 
based on what the country 
needs 


When choosing which measures of learning to invest 
in, policy makers must consider the context. If assess- 
ment systems are nascent, priority should be given 
to fostering classroom assessment. Once that piece 
is in place, countries can develop relatively quick, 
sample-based, low-cost national assessments. When 
classroom and national assessments are established, 
much can be gained from participating in regional or 
global assessments that enable performance bench- 
marking. The ultimate goal is to build assessment 
systems in which different parts are aligned but serve 
different needs. 

Not every student needs to be tested in national 
assessments. Sample-based assessments can accu- 
rately measure a system’s performance. These 
assessments still require capable administrators, 
but they are much less expensive than census-based 
assessments. They can also be administered more 
often. Schools participating in these assessments do 
not have to be identified. This helps lower the stakes, 
making the assessments less susceptible to perverse 
responses by teachers or schools. 

Assessment systems should test students at an age 
when effective remedial action remains possible. Of 
121 countries in four regions, a third lack any report- 
ing data on the reading and mathematics proficiency 
levels of children at the end of primary school.*? Only 


half of the countries surveyed produce data or partic- 
ipate in any regional or international tests to assess 
mathematics at the end of lower secondary school. 
Just under half assess reading. This means that 
comparable information about learning is missing 
for most children and youth outside of high-income 
countries (figure 4.1).*° 


Will learning metrics narrow 
the vision for education? 


Putting emphasis on measurable learning does not 
mean ignoring other outcomes of education, such as 
physical, moral, civic, or artistic development. Indeed, 
focusing on learning—and on the educational quality 
that drives it—is more likely to crowd in these other 
desirable outcomes. Conditions that allow children to 
spend two or three years in school without learning 
to read a single word or to reach the end of primary 
school without learning two-digit subtraction are 
not conducive to reaching the higher goals of edu- 
cation. An experiment in Andhra Pradesh, India, that 
rewarded teachers for gains in measured learning in 
math and language led to improved outcomes not just 
in those subjects, but also in science and social stud- 
ies—even though there were no rewards for improve- 
ment in the latter two subjects.“ A study of ninth 
graders in the United States found that behavioral 
factors correlate positively with test scores.*? Another 
US. study revealed that teachers who improve test 
scores also improve broad outcomes into adulthood.# 


Figure 4.1 No internationally comparable data on learning are available for most 


children outside of high-income countries 


Percentage of children in countries that have reported mathematics and reading scores since 2000 for ASER, EGRA, 
LLECE, PASEC, PIRLS, PISA, SACMEQ, and TIMSS, by income group 
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Trends in International Mathematics and Science Study. 
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Learning assessments of key foundational subjects 
such as language and mathematics are likely to be 
good proxies for whether an education system is 
delivering on its broad promise. 

That said, cognitive skills are not the only skills 
that matter. Socioemotional skills (sometimes called 
noncognitive skills) such as grit, self-control, self- 
management, effective communication, and _pro- 
social behavior can be central to not just economic 
outcomes but life outcomes more broadly. Evidence 
from high-income countries suggests that such skills 
strongly affect employment status, work experience, 
occupational choice, and wages.*® They also reduce 
risky behaviors such as crime, violence, or drug 
use.*® For example, a study from the United Kingdom 
found that even after controlling for cognitive skills, 
socioemotional skills were important for predicting 
whether individuals stayed in school, obtained a 
degree, were employed, smoked, or were involved in 
a crime.*” An understanding of how to measure these 
skills, along with how to influence them, is growing 
rapidly.* Like cognitive skills, socioemotional skills 
develop early in life but are malleable.* In fact, socio- 
emotional skills help build cognitive skills and vice 
versa, with current skill levels dependent on invest- 
ments made earlier in life (see spotlight 3).°° 

Lower-performing countries probably do not face 
the same sharp trade-offs faced by high-performing 
countries on the education frontier. Economists use 
the concept of the production possibilities frontier 


Figure 4.2 Low-performing countries don’t face 
sharp trade-offs between learning and other 
education outputs 
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to understand how producers—or in this case, coun- 
tries—make trade-offs between production of differ- 
ent goods (figure 4.2). For example, in recent years 
many stakeholders in the Republic of Korea have 
argued that their high-performing education system 
places too much emphasis on test scores (shown in 
figure 4.2 as “measured learning”) and not enough 
on creativity or certain socioemotional skills such as 
teamwork (“other outputs”). Implicitly, this Korean 
debate is about whether to try to move up and to 
the left on the frontier—that is, from A toward B. 
But in the low-learning trap, represented by “low- 
performing country C” in the figure, there is so much 
slack that this OECD-driven debate is not relevant. 
Country C has an opportunity to improve on both 
measured learning and other education outputs at 
the same time. 


Six tips for effective learning 
measurement 


Tip 1: Measure gaps. The learning crisis will be truly 
salient politically only when vulnerable subpopula- 
tions, who are disproportionately likely to suffer from 
learning gaps, are adequately covered by national 
assessment systems. To ensure that happens, assess- 
ments should be deployed in a way that shines a light 
on all children. Measurement must allow for the 
disaggregation of data around important dimensions 
such as socioeconomic status, gender, location, or dis- 
ability status. In particular, groups at risk for social or 
economic exclusion may need to be oversampled to 
ensure adequate representation.” 

Tip 2: Track progress. The use of uniform method- 
ologies, approaches, and psychometrics across years 
is crucial for education systems to discern trends in 
learning over time and changes in learning gaps across 
tests. Year-on-year comparisons of learning progress 
should also be ensured for vulnerable subpopulations. 

Tip 3: Test students when effective action is still possible. 
Returns from student assessments will be maximized 
if they focus on ensuring that students attain basic 
skills—literacy, numeracy, critical thinking—early 
in their schooling. Systems should also consider 
household-based testing, which would allow assess- 
ments to cover students not currently in school, 
making the resulting measurement more useful for 
universal learning targets. Household testing would 
also allow more nuanced understanding of all the 
different influences on a child’s school access and 
learning outcomes. To that end, standardized learn- 
ing modules can be included at little additional cost 


in surveys conducted both nationally (such as income 
and consumption surveys) and internationally (such 
as Living Standards Measurement Study surveys or 
Demographic and Health Surveys). 

Tip 4: Balance the stakes. No single measure should 
be misused or overused. One way to avoid that out- 
come is to frame learning measures that guide policy 
as low-stakes diagnostic tools—not as one summary 
number that determines sanctions and rewards. 
Again, “learning metrics” should be considered a sys- 
tem of tools, each with its own place and purpose.” 

Tip 5: Good design is not enough—facilitate action. 
Learning measures should be used explicitly not 
just for tracking progress, but also for policy mak- 
ing.3 One way to ensure that happens is to devote 
resources (including effort) to the timely distribution 


Box 4.2 A global learning metric? 


A global learning metric could help bring learning center 
stage, making it more salient. Such a metric would use an 
internationally comparable scale to consistently track prog- 
ress and identify gaps across contexts. It would enable com- 
parisons across children, households, schools, and locations. 

Beyond its technical dividends, a global metric would 
motivate action and generate accountability for learning. 
By showing what is possible, it could point to what coun- 
tries should be aspiring to—and create pressure to meet 
those aspirations. By benchmarking learning gaps among 
disadvantaged groups, a global metric could also create 
pressures for social mobility within countries. Furthermore, 
comparable learning data could increase the effectiveness 
of global research, international partnerships, and global 
aid for learning. Such data could also help countries 
develop their capacity for analyzing results to drive policy. 

To be sure, there are technical and political challenges 
that would go hand in hand with adopting a global metric. 
The first is how to generate a global consensus on the met- 
ric’s scope. A global metric would require making choices 
about approach, target sample, and interpretation, which 
could prove controversial. In addition, challenges would 
arise with financing, implementation capacity, and political 
will. Many developing countries lack infrastructure for data 
collection, organization, analysis, and mechanisms to pro- 
vide feedback to educators, parents, or communities. These 
are all necessary ingredients for turning metrics into action. 


Source: WDR 2018 team. 
a. Schaferhoff and Burnett (2016). 


of understandable results to key stakeholders. Another 
factor is an open, collaborative process for instrument 
design. Student assessments developed with the col- 
laboration of various stakeholders are more likely to 
be considered valid and relevant at local levels. 

Tip 6: Exploit global public goods on learning. Lever- 
aging international assessments can yield high 
returns. For example, there is considerable advantage 
to forging common links between international and 
regional assessments so they can be put on the same 
scale. This not only increases harmonization between 
international assessments such as PISA and TIMSS, 
but also allows ties to national and citizen-led assess- 
ments, enabling meaningful global tracking (box 4.2). 
Researchers have tried to link various assessments 
after the fact, but these attempts have faced severe 


But most of these problems are surmountable. Global 
advocacy is generating sound technical recommendations 
on what a global metric could look like. Although there are 
no agreed-on standards of proficiency and no agreed-on 
tests to ensure that countries’ measures of learning are 
comparable to each other and over time, several global 
initiatives—such as the Global Alliance to Monitor Learning, 
the Assessment for Learning (A4L) initiative, and the 
International Commission on Financing Global Education 
Opportunity—are generating momentum. Other challenges 
could be overcome through clear goals and quality thresh- 
olds. A global metric can succeed only if it is explicitly 
framed as a complement to national assessment systems— 
not as a substitute for them. In fact, information from the 
global metric could be used to strengthen the capacity of 
national systems. 

The political will needed for a global metric might be 
easier to mobilize if the needs of developing countries 
are prioritized and the metric’s advantages are clearly 
communicated. Estimates suggest that only 3 percent of 
official development assistance for education is spent on 
global public goods such as data and research; for health, 
that share is 20 percent.? Returns from investing more on 
education data could be enormous if they help focus atten- 
tion on ensuring that students attain basic skills in their 
early years. 
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technical challenges.** Ex ante linking of measure- 
ments through common items is likely to prove much 
more technically sound and cost-effective. 


eK 


Education systems are unlikely to tackle the learning 
crisis unless it becomes clearly visible. This is possible 
only through well-designed measures of learning. To 
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be effective, “learning metrics” must overcome two 
important challenges: ensuring that information 
leads to action, and minimizing the potential per- 
verse impacts of measurement. Alarm at the rise of 
a “testing” culture has dominated recent discourse. 
But in most low-learning contexts there is too little 
assessment and, consequently, too little accountabil- 
ity for learning in the system. 
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SPOTLIGHT 3 


The multidimensionality 


of skills 


Having knowledge is not the same as being able to 
apply it Having a skill means having the ability to do 
something well. Having a skill requires knowledge, 
but having knowledge does not necessarily imply 
having skills? Knowing how a wind turbine works 
does not mean a person has the skill to fix one. 


Skills are multidimensional, 
dynamic, and interactive 


Promoting a breadth of skills means “educating for 
a mastery of a wide range of competencies that will 
help mitigate the challenges posed by our changing 
world context.”3 This Report uses three broad catego- 
ries of skills (figure $3.1): 

Cognitive skills refers to the “ability to understand 
complex ideas, to adapt effectively to the environ- 
ment, to learn from experience, to engage in various 
forms of reasoning, to overcome obstacles by taking 
thought.”* Cognitive skills are needed for learning, 
personal and professional development, and the 
development of other types of skills. They can be bro- 
ken down into foundational skills—which include basic 
literacy, numeracy, critical thinking, and problem- 
solving—and higher-order skills such as more advanced 
versions of these cognitive skills and others like adap- 
tive learning. 

Socioemotional skills are the behaviors, attitudes, 
and values that a person needs to “navigate interper- 
sonal and social situations effectively,”> as well as to 
“deal effectively and ethically with daily tasks and 
challenges.”® Self-awareness, leadership, teamwork, 
self-control, and motivation are socioemotional skills.” 
Sometimes referred to as noncognitive skills, socioemo- 
tional skills include so-called personality traits, which 
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reflect enduring patterns in how individuals respond 
to various situations. Socioemotional skills are trans- 
versal skills, meaning they are relevant to a broad 
range of disciplines. They work together with cogni- 
tive skills, in that success in meeting many workplace 
and life challenges depends on both types of skills. 

Technical skills are the acquired knowledge, exper- 
tise, and interactions needed by a worker for com- 
petent performance of the duties associated with a 
specific job. Technical skills require mastery of the 
knowledge, materials, tools, and technologies needed 
to do a job.’ 

Cognitive skills and socioemotional skills reinforce 
each other. Individuals with characteristics such as 
drive, diligence, perseverance, or good social skills 
are more likely to apply themselves to acquiring 
cognitive skills, as well as to have positive relation- 
ships in their lives. Yet cognitive skills are distinct 
from socioemotional skills.» Acquiring an early solid 
base of both is critical because both set the course of 
lifetime trajectories. Individuals with early advantages 
tend to gain more skills over their lifetimes, and it is 
difficult for others to close widening gaps over time. 


Skills can be acquired 


Different types of skills can be developed over time, 
depending on an individual's neurobiological and psy- 
chological development.’ 

Most cognitive skills are acquired during child- 
hood, but they can be reinforced through young adult- 
hood. Early childhood is an optimal period to acquire 
foundational cognitive skills because they are a pre- 
requisite to developing further cognitive and socio- 
emotional skills during later developmental periods." 


Figure S3.1 Cognitive, socioemotional, and technical skills interact 
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Higher-order cognitive skills are regularly developed 
in late adolescence and early adulthood, in parallel 
with technical skills that are relevant for the labor 
market.” Given the ages that correspond to optimal 
skills development periods, foundational cognitive 
skills are usually learned in school and at home. 
Similarly, socioemotional skills can be acquired 
through adulthood, though the optimal period is 
in early childhood, while the best stage to reinforce 
them is early adulthood. But unlike cognitive skills, 
certain socioemotional skills—such as self-esteem, 


positive identity, or leadership—are better acquired 
in middle childhood and during adolescence.3 Even 
though the neurobiological and psychosocial bases 
are already well established at this stage, socioemo- 
tional skills can also be learned well during early 
adulthood through new experiences.“ 

Technical skills can be learned at ages and in set- 
tings that correspond to the fields of study or jobs that 
a person chooses. Thus these skills can be acquired 
throughout life, in school and the workplace, as well 
as through specific training and education.» 
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1. Schonfeld (2017). 

. For a discussion of alternative definitions of the term 
skills, see Green (2011) and Warhurst and others (2017). 
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. Guerra, Modecki, and Cunningham (2014, 5). 

. “Core SEL Competencies,’ CASEL, http://www.casel.org 
/core-competencies/. Also see Pierre and others (2014) 
and Taylor and others (2017). 

7. Duckworth and Yeager (2015); Durlak and others (2011); 
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SPOTLIGHT 4 


Learning about learning 


Identifying gaps between evidence and practice helps set priorities for action. 


As evidence of the learning crisis has grown, so has 
understanding of what produces learning. Cognitive 
neuroscience has evolved dramatically, with brain 
imaging revealing new insights into how children 
learn.’ Over the last two decades, neuroscience has 
been instrumental to understanding early child brain 
development and the crucial nature of the early years. 
Schools in many parts of the world are innovating in 
approaches to pedagogy, professional development, 
and the use of new technologies. Governments and 
nonprofits are trying out innovative programs to 
upgrade teachers’ skills on the job.* 

At the same time, evidence on which programs 
most effectively boost learning is mushrooming. 
One example of that growth: the number of impact 
evaluations of interventions intended to improve 
learning outcomes in developing countries rose from 
19 in 2000 to 299 by 2016 (figure S4.1).5 This evidence 


Figure S4.1 The number of experimental and quasi- 
experimental studies of interventions to improve 
learning has mushroomed in recent decades 
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translates into clearer insights into how to improve 
learning at the level of the student, the classroom, 
and the school. Beyond the increase in their num- 
ber, these impact evaluations have also grown more 
sophisticated over time, making them more useful for 
policy making. They are now more likely to compare 
multiple interventions, more likely to study a wide 
range of interventions overall, and more likely to 
study interventions on a large scale. The evaluations 
show that many of these interventions have sizable 
impacts. Several pedagogical interventions, for exam- 
ple, deliver learning gains greater than what students 
would learn in a year of business-as-usual schooling.® 


Making better use of 
evidence 


Not all evidence is created equal, but many different 
kinds of evidence can be credible. Scientific evidence 
demonstrates the pathways of brain development and 
functioning. Social science evidence can effectively 
answer the question of what would have happened in 
the absence of a reform or intervention (often called 
a counterfactual). Randomized controlled trials or 
analyses of “natural experiments” are useful tools for 
determining such a counterfactual. Implementation 
science and case studies can provide a detailed picture 
of how an intervention or a phenomenon works. The 
best evidence of what improves learning draws from 
a range of methods. 

Even when an intervention in one education sys- 
tem has a positive impact, it may not work everywhere. 
Effects may differ when translating from one location 
to another or from a pilot study to a large-scale pro- 
gram. What works in Peru may not work in Burundi 
because the education systems and societies are differ- 
ent. A common intervention that has been tested in a 
range of settings is to reduce class size. But increasing 


class size by 10 students reduced test scores by four 
times as much in Israel as it did in Kenya.’ A pilot inter- 
vention may allow for more controlled conditions than 
an at-scale intervention. In Kenya, an intervention to 
hire contract teachers was effective on a small scale, 
but when it was implemented at scale through govern- 
ment systems, salaries were delayed and ultimately the 
contract teachers were converted to civil servants.® The 
scaled-up program no longer resembled the successful 
pilot, and the learning gains failed to materialize. 

To make sense of the evidence, policy makers 
should consider the likely principles behind effective 
programs rather than fixating on results (or “point 
estimates”) from individual studies.° For example, pro- 
grams that provide financial incentives for teachers 
have had mixed effects. Rather than taking a simple 
average of the effects, a nuanced assessment would 
reveal that these programs tend to work better when 
improving quality is relatively simple and within a 
teacher's control—for example, when they increase 
teacher attendance or teaching time while at school.° 

Viewing evidence through models of human 
behavior is one way to focus on principles. This 
means examining patterns of results and using mod- 
els to infer why results vary across settings. The first 
step would be a nuanced synthesis, bringing together 
the results of a range of studies and examining 
empirical patterns. The second step would be using 


theory—models of human behavior—to explain why 
some proposed solutions work and others do not, as 
well as why the same solution may work in one locale 
or time but not in another. 


Producing learning is 
complex, but investments 
that change what happens 
in the classroom are a 
good bet 


Many actors contribute to the learning process, and 
they all face their own incentives. The direct inputs 
to the learning process include the choices made by 
learners themselves, as well as by their parents, teach- 
ers, and other school leaders, interacting with the 
available infrastructure and materials. Less immedi- 
ate but still important, bureaucrats, politicians, and 
nonstate players make decisions that influence edu- 
cation quality. Understanding these relationships is 
crucial to interpreting evidence. 

Each actor in the learning process reacts to the 
others, so changing one element of the process does 
not guarantee more learning. Many of the inputs to 
the learning process are choices made by the actors— 
choices made in reaction to the actual and anticipated 
choices of other actors (figure S4.2). Teachers react to 


Figure S4.2 It’s more complicated than it looks: People act in 
reaction to the choices of others throughout the system 
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changes in school leadership, school directors react to 
community demands, and parents react to changes 
in government policy. In India and Zambia, grants to 
schools led parents to reduce their own investments 
in their children’s schooling.” In a household with 
few resources, if the government begins providing 
textbooks, a parent may well reallocate education 
resources to other needs, such as health. 

How can we make sense of all of these complex, 
dynamic relationships? Models of human behavior 
illuminate the motives for choices and actions, and 
they can help guide solutions. Simple optimizing 
behavior models—in which actors maximize their 
well-being subject to limited budgets and other con- 
straints—explain why parents reduce their contribu- 
tions when schools increase theirs. Principal-agent 
models that incorporate multiple actors with dif- 
ferent objectives explain why teachers may fail to 
teach when not sufficiently motivated or monitored. 
Behavioral models also play a role: student learning 
and educational aspirations can be affected by the 
salience of stereotypes. Economic phenomena such as 
information, market, and coordination failures play a 
role in these models. The models can also illuminate 
why a gap is often observed between evidence on how 
to improve learning and actual practice. 


Focusing where the gaps 
between evidence and 
practice are largest 


Gaps between evidence and actual practice provide 
entry points for efforts to improve education. These 
gaps come to light when evidence shows that certain 
approaches or interventions can improve outcomes, 
but the approaches used in practice are different.” 
For example, the accumulated research evidence 
demonstrates high returns to early investments 
in children, yet families and governments in low- 
income environments do not prioritize these invest- 
ments. Evidence shows that certain types of teacher 
professional development deliver much higher 
learning gains than others, but outdated training 
methods persist. Because the gap between evidence 
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and practice requires good information on what the 
evidence says, as well as what current practice is, it 
is likely that many opportunities for improvement 
have yet to be discovered. 

Intuition and common sense are not enough. One 
fundamental lesson from the growing evidence base 
is that intuition is not always a trustworthy guide. It 
may miss the complexity of motivations and reac- 
tions in the real world, as can happen when teacher 
financial incentives induce cheating rather than 
more effort. Intuition may fail to capture the net 
effect of conflicting forces, such as when separating 
students by ability allows teachers to target teaching 
more specifically to students’ level—which should 
increase their learning—but also distances them from 
their high-performing peers—which may decrease 
their learning. 

Knowledge about improving learning must 
take both the costs and the benefits of learning inter- 
ventions into account. A computer-assisted learning 
intervention in India increased learning more than 
employing contract teachers in Kenya, but hiring 
contract teachers was so much cheaper that it deliv- 
ered a higher return on investment.® The evidence 
base on costs is much thinner than that on ben- 
efits, with a tiny fraction of studies examining 
both.’* But some programs have been evaluated on 
both effectiveness and cost-effectiveness.” This evi- 
dence on costs—adapted to local contexts—should 
qualify policy recommendations." 

The gaps between evidence and practice signal 
promising places to start, rather than the end of 
learning how to improve learning. Interventions can- 
not simply be exported from one country to another. 
Indeed, at times the effectiveness of an apparently 
similar intervention can vary even within a country, 
depending on how the program is implemented.” 
The cost of implementation will also vary dramat- 
ically across contexts.”° But this does not mean that 
evidence from other contexts is without value. On the 
contrary, successes in other environments—coupled 
with a careful analysis of why the programs work— 
provide a starting point. Policy makers can draw on 
this evidence and experiment in their own policy 
environment. 
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There is no learning 
without prepared, 
motivated learners 


Strong foundations underpin all learning and skills development. Learning depends 
on students who are prepared, present, and motivated—but getting students there 
will often require policy change within and beyond education systems. 


Schools cannot produce learning without prepared, 
present, motivated learners. Around the world, many 
children receive too little investment in nutrition and 
stimulation during their early years, and many lack 
access to quality early learning opportunities that can 
prepare them for first grade. The one in four children 
worldwide who are stunted cannot achieve their 
potential in school.’ Nor can the 263 million young 
people who do not make it to school at all. Among 
those who do attend, motivation to learn often suffers 
when the quality of education is low. A poor-quality 
basic education also means that learners who should 
be gaining advanced skills from tertiary education or 
technical training lack the preparation to do so. Thus, 
just as the fundamental investments needed for pri- 
mary education must be made before a child enters 
school, the same is true for skills training. In many 
cases, the failure to invest effectively can be under- 
stood through models of human behavior, which also 
point the way to solutions (table 5.1). A synthesis of the 
evidence in these areas reveals three key principles 
for improving learning: 


e 


To set children on high-development trajectories, 
foster cognitive and socioemotional development 
through early child nutrition, care, stimulation, and 
learning opportunities. 

To get children into school—an essential first step 
to learning—lower school costs and then use other 
tools to boost motivation for learning. 


e 
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* To address the fact that so many youth leave basic 
education lacking skills, recognize that remediation 
often needs to be the first step in further education 
and training. 


Investing in their early years 
prepares children for school 


Children’s early years offer a rare window for societies 
to make investments in their children with extremely 
high returns (figure 5.1). Efforts to improve children’s 
lives can significantly increase individual and societal 
productivity while reducing inequality. Children can- 
not thrive with stunted bodies and brains, and early 
gaps in learning and skills trap them in lower develop- 
mental trajectories from which it becomes increasingly 
difficult to escape (spotlight 2). Though children’s bod- 
ies are resilient, and catch-up after early childhood may 
be possible when inputs improve, it is extremely dif- 
ficult to reverse the effects of exposure to risk factors 
in the first few years of a child’s life. Doing so entails 
costly, high-quality interventions that typically need to 
happen at a sufficiently young age to be effective. 


Recognizing the dangers that poverty 
poses to children’s development and 
learning 

Children need quality environmental inputs to grow 
in a healthy, timely fashion. Essential physical inputs 


Table 5.1 Models of human behavior can guide actions to improve learner preparation: 


Some examples 


Where this fails 


Synthesis principle 


Just one in five children 
in low-income countries 
attend preschool. One in 
four children worldwide 
are stunted. 


Provide early child 
nutrition, care, 
stimulation, and learning 
opportunities. 


Models that identify a 
mechanism behind this failure 


Information failure: Stakeholders 
may not be aware of relative 
returns to early investments or how 
to support early development. 


Simple optimization with liquidity 
and credit constraints: Parents are 
aware but lack the resources to 
invest. 


Behavioral (mental bandwidth): 
Stress of poverty undermines 
parenting capacity. 


Approaches that address the 
modeled mechanism 


In Jamaica, a program taught 
caregivers to provide psychosocial 
stimulation that improved stunted 
children’s developmental scores 
and later life outcomes. 


In Mexico, a conditional cash 
transfer program improved 
cognitive and motor development. 


In Argentina, Bangladesh, China, 
and Uganda, center-based 
programs improved children’s 
outcomes. 


263 million children 
remain out of school. Many 
countries still charge fees 
for lower secondary school, 
and primary school, while 
usually tuition-free, still 
entails cash outlays in 
many settings. 


Lower school costs; 
boost motivation and 
effort. 


Simple optimization with liquidity 
and credit constraints: Parents are 
aware but lack the resources to 
invest in any or all children. 


Information failure: Youth and 
parents may underestimate the 
returns to education. 


Behavioral (hyperbolic discounting): 
Youth may recognize the value of 
education but plan to invest later 
(yet “later” never comes). 


In Cambodia, providing 
scholarships to girls dramatically 
increased enrollment. 


In the Dominican Republic and 
Madagascar, providing information 
on the returns to education 
improved enrollment and learning. 


In Pakistan, reporting child test 
scores fo parents increased 
enrollment and learning outcomes. 


Many skills training 
programs assume 
prerequisite skills that 
youth do not have. 


Ensure that, where 
needed, remediation is 
the first step in further 
education and training. 


Information failure: Training 
programs receive imperfect signals 
about the quality of incoming 
learners. 


Simple optimization (on the part of 
training centers): Remedial students 
are highly likely to drop out. 


In U.S. community colleges, 
improving course placement 
accuracy and support services 
helped increase students’ long-term 
performance. 


In the United States, bridge 
programs help learners move past 
remediation quickly. 


Source: WDR 2018 team. 


include quality pre- and postnatal nutrition, health 
care, and safe physical environments.‘ Equally crucial 
are social inputs, including nurturing, protection, and 
stimulation.’ Interactions between children and their 
caregivers—who are often, but not always, their par- 
ents—leave a significant imprint, literally shaping the 
developing brain.*° Yet poor children’s access to these 
inputs—along with caregivers’ awareness of their 
importance—is often limited. So are programs that 
invest in children’s early development and the policies 
that guide them. 

Poor children are more exposed to health shocks 
and less likely to receive stimulation, care, and pro- 
tection from stress. Nutrient deprivation, infectious 


diseases, and chemically toxic or physically dan- 
gerous environments affect many poor children 
not only after birth, but also in the womb. Exposure 
to any of these factors during sensitive periods can 
inhibit normal biological development (spotlight 1), 
but poor children often encounter these factors in 
tandem and over time.’ At the same time, the strains 
associated with poverty can disrupt parents’ deci- 
sion making and limit their availability, sensitivity, 
and responsiveness.’ As a result, poorer children not 
only have fewer resources such as books or toys, but 
also receive less stimulation, direction, and support. 
Poor children are also more likely to experience 
neglect and harsher discipline, which disrupts early 
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Figure 5.1 Investments in high-quality programs 
during children’s early years pay off 
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emotional organization—the keystone of socioemo- 
tional abilities—and is associated with worse school 
performance.” 

Early childhood development programs are 
insufficient in number and quality to compensate 
for poor children’s disadvantages, especially in the 
developing world. In poor communities, resources 
that stimulate early development outside the home— 
including quality child care, libraries, recreation 
centers, and preschool programs—tend to be limited 
and low in quality." Only half of 3- to 6-year-olds have 
access to preprimary education. Coverage is strongly 
associated with income, ranging from 19 percent in 
low-income countries to 86 percent in high-income 
countries, with poorer children enrolled at the lowest 
rates in every country.” Children under 3 are widely 
underserved, with access to services for this age 
group especially inequitable and uncoordinated.¥ 
Moreover, reliance on poorly compensated child care 
workers who receive little to no training, mentoring, 
or monitoring undermines sustainability, retention, 
and quality.* 

Governments do not invest enough in young chil- 
dren. Insufficient understanding of the high payoffs 
to early interventions, budget constraints, and the 
challenges of delivering wide-ranging early childhood 
interventions—health, nutrition, early learning— 
result in low public investment in young children in 
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most regions. In Sub-Saharan Africa, on average just 
2 percent of the education budget goes to preprimary 
education. In Latin America, the average per capita 
government spending on children under 5 is a third 
of that for children ages 6-11. Investments in the 
early years have increased in developing countries, 
but strategies often focus on building preschools, 
neglecting children who have not yet reached pre- 
school age. Though preschool can help, foundations 
across developmental dimensions are set before age 3. 
Yet this age group typically receives little government 
coverage beyond health and nutrition checkups—not 
enough for healthy overall development. 

Early exposure to risks associated with poverty 
may prevent children from realizing the promise 
of education. Intense deprivation can result in poor 
developmental outcomes—such as stunted growth 
or impaired brain development—that are difficult to 
address (figure 5.2; spotlight 2). Children who have 
fallen behind in their physical, cognitive, linguistic, or 
socioemotional development are more likely to enter 
grade 1 late, score poorly in school, repeat grades, drop 
out before they complete primary school, experience 
poor health throughout their lives, engage in high-risk 
behavior (particularly in adolescence), be less produc- 
tive, and have lower earnings.” The scale of the prob- 
lem is vast: nearly half of children under 5 in develop- 
ing countries are stunted or live in extreme poverty, 
threatening their prospects of benefiting from the 
opportunities education can provide." 


Strengthening children’s ability to learn 
with well-designed interventions 

Effective early childhood interventions can signifi- 
cantly improve poor children’s ability to learn. In the 
United States, at-risk children who participated in 
well-designed interventions—Perry Preschool, Abece- 
darian, the Nurse-Family Partnership—benefited well 
beyond their early years: their school performance, 
employment, income, overall welfare, and social 
integration all improved. Such interventions have 
substantial potential in developing countries because 
of their lower baselines. In Jamaica, the Reach Up and 
Learn program, which promoted early child stimula- 
tion, led to lower crime rates, better mental health, and 
25 percent higher earnings two decades later. There is 
a consensus on what children need: nutrition, care, 
stimulation, nurturing, and protection. The evidence 
on when to implement programs is in line with bio- 
logical evidence: prevention and early remediation are 
most cost-effective at specific points in development 
because adjustments beyond sensitive periods are 


difficult, costly, and usually incomplete. But iden- 
tifying the most effective approaches to improving 
poor children’s developmental outcomes has proven 
challenging because of the enormous heterogeneity 
in interventions as well as contexts. Still, several 
approaches show promise. 

Health and nutrition interventions during the 
first 1,000 days of life (starting at conception) improve 
children’s development. Programs that increase 
access to maternal health services improve maternal 
nutrition through diet, supplements, and fortifica- 
tion, while reducing child mortality and early health 
problems.” In isolation, nutritional interventions for 
children have only modest effects on height or stunt- 
ing.° But when combined with improved sanitation, 
along with access to child health services, nutritional 
interventions can yield significant benefits.” Breast- 
feeding and micronutrient supplements are associ- 
ated with better health and greater cognitive ability, 
leading to better educational outcomes in developing 
countries. Deworming, iodine supplements, and 
immunizations have also led to major improvements 
in children’s ability to learn.” 

Programs that build caregivers’ capacity to sup- 
port healthy development can substantially improve 
children’s outcomes. Interventions include coaching 
caregivers at home on positive discipline, as well as 
promoting increased frequency of quality interven- 
tions through nurturing, protection, and stimulating 
activities (storytelling, singing, playing with house- 
hold objects). Such interventions have been delivered 
in diverse ways, including home visits, community 
meetings, and health checkups.** The most effective 
programs have systematic training and curriculums, 
as well as opportunities for caregivers to practice 
and receive feedback.** An emerging generation of 
programs is offering parents incentives through 
positive reinforcements, with indirect “nudges” when 
providing information is insufficient or when beliefs 
or norms are detrimental.”® 

Programs that provide caregivers with cash or 
psychosocial support complement interventions 
to improve parenting. Cash transfer programs can 
address acute material deprivation in households 
and improve developmental outcomes, particularly 
when provided alongside—or conditional on—prena- 
tal care and child services. For example, conditional 
cash transfer (CCT) programs in Ecuador, Mexico, 
and Nicaragua have reduced stunting, improved 
cognitive development, and promoted better par- 
enting practices.” In Mexico, parenting support 
programs integrated with CCT programs improved 


Figure 5.2 Intense deprivation can impair brain 
development 
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neurons, muscles, and glands. It is apparent how much denser and more elaborate the connections are 
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child outcomes beyond the direct effects of the trans- 
fers.’ Also important, transfer programs can alleviate 
parental time and psychological constraints. In addi- 
tion, interventions delivered by supervised, nonspe- 
cialist health or community workers to address acute 
maternal stress, depression, and anxiety have led to 
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better cognitive development, more physical growth, 
less diarrhea, and higher immunization rates.” 

Center-based care can promote foundational 
skills. In countries from Ethiopia to the United States, 
high-quality, center-based programs have shown sub- 
stantial benefits in developing children’s language, 
cognitive, motor, and socioemotional skills.3° By con- 
trast, attending a low-quality, center-based program 
can be worse than attending none at all.* The quality 
of child-caregiver interactions is a key determinant 
of such programs’ impacts, as Indonesia and Mozam- 
bique demonstrated with effective center-based 
preschool programs for children ages 3 to 6. These pro- 
grams included minimal infrastructure investments 
but improved children’s cognitive abilities thanks to 
their interactions with well-trained caregivers (box 
5.1).* Delivering quality, center-based interventions for 
children under 3 is harder because they require costlier 
structural investments (such as lower child-to-staff 
ratios). Consequently, programs to build parenting 
capacity might be most cost-effective for children 
under 3 in resource-constrained environments or to 
reach marginalized populations. 


Bringing it all together 
Integrating programs can lead to better development 
outcomes. Poor children are exposed to multiple risk 


factors that cannot be adequately addressed by any 
single intervention. Multifactor programs capture the 
complex, complementary nature of early childhood 
development and exploit complementarities (figure 
5.3).34 To be effective, interventions must be delivered 
during specific stages of development.** Packaging 
interventions to address sequential or related devel- 
opmental goals can increase effectiveness, especially 
if intervention packages incorporate benefits for 
caregivers as well. Integrated intervention packages 
can build on existing platforms such as community- 
based strategies or social safety nets, though the 
effectiveness of any specific strategy will depend on 
contextual factors.’ Quality should not be diluted in 
the effort to increase investments in the early years— 
say, by relying on volunteers or unqualified workers 
to deliver services, which is common.?? 


Providing demand-side 
support can get kids to 
school, but not necessarily 
to learn 

School is a key input to at-scale learning. Despite 


major gains in access, many children still don't attend 
school. Even though school is not the only place that 


Box 5.1 Early childhood education prepares young children for school 


Preschool programs targeting children ages 3-6 can foster 
foundational skills and boost children’s ability to learn. 
Children who attend preschool have higher attendance and 
better achievement in primary school. Moreover, they are 
less likely to repeat, drop out, or need remedial or special 
education, all of which benefit not only students but also 
education systems because efficiency is increased.’ Across 
countries at all income levels, the most disadvantaged 
children benefit most from quality early child education 
programs.® But early child education programs are not all 
equally effective; overly academic and structured programs 
for children under 5 may undermine their cognitive and 
socioemotional skills, as well as their motivation to learn, 
because young children learn best through exploration, 


Source: WDR 2018 team. 
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d. Phillips and others (2017). 
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play, and interaction with others.‘ Key elements of pro- 
grams that have led to strong preschool outcomes include 
curriculums that foster crucial pre-academic abilities (emo- 
tional security, curiosity, language, self-regulation) through 
play; professional development plus coaching that enable 
teachers to effectively implement relevant curriculums; 
and positive, engaging classrooms that promote children’s 
innate drive to learn.‘ For early child education gains to be 
sustained, the content, budget, and capacity of providers 
of preschool programs should be integrated into formal 
education systems. In addition, the quality of subsequent 
learning environments in primary school is an import- 
ant determinant of the long-term effects of preschool 
programs. 


Figure 5.3 Integrated programs through the early years are necessary for proper child 


development 
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children learn (box 5.2), most parents want their chil- 
dren to go to school. Moreover, most children want to 
go. In a survey of Indian mothers with an average of 
less than three years of education, 94 percent hoped 
their children would complete at least grade 10. In 
Kenya, among parents with no education at all, more 
than half wanted a university education for their 
children.” 

Significant costs—both formal fees and a wide 
array of other expenses—prevent children, especially 
the most vulnerable, from learning. Nearly 90 percent 
of the world’s low-income countries proclaim free 
primary education. But for lower secondary educa- 
tion, more than 40 percent of the countries charge 
fees, along with 10 percent of middle-income coun- 
tries.*° In Africa, almost half the expenditures that 
households incur to send their children to school—for 


2 years 


3 years 4 years 5 years 


rT @4 a} CoM aX=¥-]i40m- lave Me (=n'/-1 ke) e)aal-Jal al ef-(ol ele l=) 


5 Preschool package 


school supplies, learning materials, transportation— 
are in addition to formal fees." These costs of school- 
ing widen the gaps in school participation separating 
poorer children from their wealthier peers. 

High aspirations for schooling among children 
and their parents explain why initiatives that ease 
constraints to schooling for households—so-called 
demand-side interventions—have been so effective 
at getting children to school. In many countries, the 
elimination of school fees has raised enrollments, 
suggesting that parents simply did not have the 
resources to pay the fees (figure 5.4). The inter- 
ventions, which have sought to reduce other costs 
associated with school, have consistently improved 
access in the form of enrollment as well as atten- 
dance. Nonmerit scholarships—which reduce fees 
on a smaller scale—have increased enrollment at the 
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Box 5.2 Communities can leverage the many hours spent outside the 


classroom to boost learning 


Much learning happens outside the classroom, including 
from tutoring and at-home programs. Across Africa and 
Asia, the Literacy Boost program has implemented com- 
munity reading activities to leverage the many hours that 
learners spend outside school. These include pairing strug- 
gling readers with stronger readers (“reading buddies”), 


Source: WDR 2018 team. 
a. Dowd and others (2017); Friedlander and Goldenberg (2016). 


Figure 5.4 What happens when school 
fees are eliminated? Evidence from 
eight countries 
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implementing read-a-thons (in which all the books that 
children read during a specific period are recorded), and 
providing mini-libraries. Children who participate in such 
activities have better reading outcomes. In Rwandese 
communities, implementing Literacy Boost led to better 
reading skills and school advancement.? 


primary level in Kenya and at the secondary level 
in Ghana.“ The flip side of reducing school fees is 
increasing household income, which cash transfer 
programs do. These programs have increased both 
primary and secondary enrollments. 

Information interventions are particularly prom- 
ising because they cost little.** In some cases, demand 
for education remains low because students and their 
families underestimate the returns to education. In 
the Dominican Republic and Madagascar, simply 
providing information on the returns to education led 
to improved educational outcomes, though a similar 
intervention in rural China had no impact.” In India, 
providing job recruiting services for women in their 
20s increased school enrollment for teenage girls. 
Gender leadership quotas in Indian villages elimi- 
nated the gender gap in educational attainment." 

Though interventions that reduce the cost of 
schooling are highly effective at increasing school 
participation for most children, especially at young 
ages, some children do require additional incentives 
to attend school. In some countries, parents give 
priority to sending to school their children with the 
highest cognitive ability or higher perceived—not nec- 
essarily actual—returns to schooling (such as boys).*? 
In Burkina Faso, beginning in 2008, some families 
received unconditional cash transfers, while others 
received cash transfers conditional on children’s 
school enrollment. Boys and children who scored bet- 
ter on tests were equally likely to be enrolled in school 
under both schemes, but transfers with conditions 
were significantly more beneficial for girls and chil- 
dren who started out at lower levels of learning.*° This 
finding suggests that the most vulnerable children 
may need more than simple cost reductions to guar- 
antee enrollment in school. 


Demand-side interventions can improve learning 
when programs increase either capacity to learn or 
student effort. Targeted cash transfers have led to more 
learning when framed to induce more effort, as have 
some information interventions.” Even in low-quality 
education systems, students learn more in school 
than out of it: there is a learning crisis, but the positive 
relationship between schooling and literacy persists 
(figure 5.5). When individuals with similar literacy 
and numeracy levels are compared, those with more 
schooling have higher earnings, most likely because of 
other benefits of schooling, including improved socio- 
emotional skills such as discipline.” Getting learners 
into school is beneficial in its own right. 

In addition to getting to school, learners must 
be motivated. One way to increase motivation is to 
ensure that learners’ skills are rewarded, whether 
by a labor market that offers high returns or by a 
higher education system that admits students based 
on merit rather than connections. Perhaps the most 
immediate way to motivate students is to provide 


Figure 5.5 Not all education systems 
are equally productive, but even the 
least productive deliver some learning 
to some learners 
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relevant, quality education that reaches them at their 
current level of learning. In Kenya, students who 
drop out of school say their inability to perform well, 
rather than costs or parental pressures, caused them 
to leave.53 Some systems seek to further motivate stu- 
dents with merit-based scholarships or prizes. Such 
incentives can improve effort as students strive to 
qualify—whether for a direct financial prize, such as 
in Benin and Mexico, or a scholarship for girls, such 
as in Kenya.** Direct financial incentives have been 
less successful in high-income countries, though 
alternate designs that deliver incentives immediately 
after tests have raised test scores.® Providing caregiv- 
ers with information about learner performance can 
also have a large impact, helping caregivers to trans- 
late motivation into action (box 5.3). But in general, 
a positive overall educational experience is likely the 
backbone of student motivation. 


Remedial education can 
prepare learners for further 
education and training 


Many young people leave formal education with 
weak foundational skills, and thus they are unpre- 
pared for further education and training. Globally, 
of every 100 students entering primary education, 
61 complete lower secondary education, and just 
35 complete upper secondary (figure 5.6).°° About a 
third of youth leave school between lower and upper 
secondary. This problem is especially pronounced in 
several developing countries, where sizable shares of 
15- to 24-year-olds score below the minimum level of 
literacy proficiency—23 percent in Chile, 29 percent in 
urban Bolivia, 34 percent in urban Ghana.’’ Improv- 
ing foundational skills early can alter workers’ labor 
market trajectories. Employed adults ages 15-64 who 
score at level 2° or above in literacy proficiency have 
significantly higher probabilities of holding high- 
skill, better-paid white-collar jobs (figure 5.7). 

Youth vary greatly in skills and maturity, putting 
them on a range of different pathways. Some young 
school leavers enroll in second-chance programs 
seeking to obtain formal education equivalency diplo- 
mas so they can gain access to further education or 
training. Others pursue remedial coursework to 
fulfill admission requirements for postsecondary 
education or training institutions.” Another group— 
usually those with the most serious skills gaps—goes 
into unstable, low-wage, low-productivity jobs, while 
some youth remain out of both school and the labor 
force.” It is difficult to reach all these young people. 
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Box 5.3 Providing information on children’s school performance can help 


parents to motivate their children 


Most parents want their children to succeed in school. 
Promising interventions in several countries show that 
providing parents with information about their children’s 
performance can lead to better educational outcomes. In 
the United States, text messages sent to parents when 
secondary school students missed assignments led not 
only to more assignment completion but also to higher test 
scores.’ Sending letters to parents about student absences 
also reduced absenteeism.° In Malawi, providing parents 
with information about their children’s academic ability 
enabled them to buy the appropriate books for their chil- 
dren.‘ In Chile, low-income families received text messages 
each week detailing their child’s attendance record along 
with a monthly message on behavior and test performance. 
Students whose parents received the texts were less likely 


Source: WDR 2018 team. 


a. Bergman (2015). 

b. Rogers and Feller (2016). 

c. Dizon-Ross (2016). 

d. Berlinski and others (2016). 

e. Lieberman, Posner, and Tsai (2014). 


to behave poorly in school, had better grades, and were 
more likely to move up to the next grade. After receiving 
the messages, parents expressed a willingness to pay for 
the service, suggesting that they saw real value to it.’ 
But simply providing information to parents is no guaran- 
tee of success: a program in Kenya that provided parents 
with information on their children’s literacy levels and 
suggested strategies to improve them did not lead to 
change.* The programs that have been effective have pro- 
vided parents with regular updates on the inputs to learn- 
ing—attendance and performance on individual assign- 
ments—rather than just on learning levels. Such information 
interventions can be automated, making them extremely 
cost-effective because they leverage the intrinsic motiva- 
tion of families. 


Figure 5.6 Young people follow different paths in their education 
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Figure 5.7 Workers with higher literacy 
proficiency are more likely to enter 
white-collar jobs 


Marginal probability of entering high-skill white-collar jobs 
relative to blue-collar jobs when scoring at level 2 or above 
in literacy proficiency, for all workers in urban areas of 
participating countries (2011-14) 
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Motivating them to join second-chance or remedial 
programs is not easy, especially if they have been 
out of the education system for some time. Many 
are uncertain about the benefits of remedial courses, 
and returning to school settings can stir up negative 
feelings. In Uganda, early school leavers said they suf- 
fered from diminished self-worth, limited life oppor- 
tunities, and social exclusion associated with early 
departure from formal education.® 

Remedial education interventions can work—if 
they reach the right people using the right approach." 
Effective remedial education interventions meet 
young people where they are, helping them transition 
into careers. Remedial programs are more likely to 
support students’ interests when they are short, rele- 
vant to students’ lives, delivered by experienced teach- 
ers, and part of a long-term plan for career growth. 
Most evidence to date comes from programs in 
high-income countries, with three main types of 
interventions standing out as promising: 


* Remedial prevention programs support academ- 
ically weak students by strengthening their foun- 
dational skills and encouraging them to complete a 
formal education. 


* Second-chance programs offer early school leavers, 
many of whom are low-skilled, an opportunity to 
reengage with education and training. 

* Remedial coursework at the onset of postsecondary 
education and training increases young people’s 
chances of completing their programs of study. 


Remedial prevention programs can help 
low-performing students and keep them 

in school 

Remedial prevention programs can help at-risk youth 
who are in the formal education system to prepare 
for rigorous academic work in further education or 
training.© Three remedial prevention approaches 
show promise." The first offers support to primary 
and secondary students willing to stay in school and 
master foundational skills. Programs in India and 
Mexico City that offer additional instruction for dis- 
advantaged students have shown positive impacts on 
foundational skills (especially in India).°* The second 
approach offers students early assessments of their 
academic standing, along with extra instruction to 
improve performance. A statewide early assessment 
program in California that supports academically 
at-risk students shows declining needs for remedi- 
ation at later stages of education and training.” The 
third approach gives secondary school students the 
option of registering concurrently in postsecondary 
courses. Participants in such programs in the United 
States are less likely to require remediation and more 
likely to persist in tertiary education and improve 
academic outcomes.” 


Second-chance programs offer a way to 
return to education and obtain training 
Second-chance programs give youth who have 
dropped out of school a path to reengage in nontra- 
ditional learning environments, obtain secondary 
education equivalency qualifications, and enter job 
training.” These programs offer a learning experience 
that signals a level of achievement to participants, 
their families, and employers. In Australia and the 
United States, early school leavers are encouraged 
to enroll in programs that provide an equivalent to 
an upper secondary diploma.” Though equivalency 
programs can improve employment, wages, and 
other education indicators (relative to outcomes for 
individuals with no credentials), such impacts are 
often smaller than those for individuals holding 
traditional educational credentials.” Across second- 
chance interventions, socioemotional skills play an 
important role in student success—with skills 
such as the ability to work toward long-term goals 
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sometimes mattering more than the equivalency 
certificate itself. 

The demand for second-chance programs is high 
and the evidence is promising, but keeping youth 
engaged in further education and training requires 
an integrated policy approach. In Sub-Saharan Africa, 
there is a demand for programs to reengage early 
school leavers, especially in low-income or conflict 
regions.” But in practice, programs tend to be small, 
and few operate within a policy framework that inte- 
grates them into the formal education and training 
systems.” For low-income students, who usually 
make up a disproportionate number of early school 
leavers around the world, second-chance programs 
like the Open Basic Programme in India can provide 
important pathways to educational opportunities.” In 
India, Indonesia, the Philippines, and Thailand, equiv- 
alency programs for early school leavers improve stu- 
dents’ self-development, especially when programs 
are aligned with the formal education system.” Sim- 
ilarly, second-chance programs in Latin America and 
the Caribbean yield better results when they take into 
account the multidimensional needs of young people, 
connect students to pathways for further education 
and training opportunities, and provide support to 
help participants return to productive adulthood.” 


Postsecondary remedial education 
programs can help youth succeed in their 
programs of study 

Many students enrolling in postsecondary education 
and training are not prepared for the rigor of their 
programs of study. In Chile and Mexico, several 
postsecondary institutions offer remedial support 
to academically underprepared students, but impact 
evaluations of such interventions are rare.” In the 
United States, participation in postsecondary reme- 
dial education is widespread, often at great cost to 
individuals and institutions.®° About 42 percent of 
incoming students in two-year institutions and 20 
percent in four-year institutions enroll in remedial 
courses at an annual cost of $1-$7 billion, depend- 
ing on how the estimates are calculated. Due to this 
high cost, U.S. institutions have been experimenting 
with new approaches. There are three main types 
of remedial models that show promise: accelerated 
remediation, contextualized instruction, and inten- 
sive student support.” 

Accelerated remediation models 
time students spend on remedial coursework. Con- 
ventional remedial education programs are often 
designed as a series of sequential courses that can 
take multiple semesters to complete, which often 


reduce the 
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leads students to drop out.” New accelerated remedial 
models addressing this problem include fast-track 
courses, self-paced modularized courses, and efforts 
to mainstream students directly into postsecondary 
courses while providing additional instructional 
support. In the U.S. state of Indiana, a study of two 
fast-track programs found participants achieve better 
course pass rates and fewer course withdrawals than 
students in longer remedial programs.® Similarly, 
evidence on self-paced modularized and mainstream- 
ing programs indicates that participants have higher 
postsecondary pass rates in math, complete more 
rigorous course requirements, and attempt tertiary 
courses at higher rates than nonparticipants.* 

Contextualized instruction improves the effec- 
tiveness of remedial education interventions, because 
learners benefit most when they engage, interpret, and 
generate meaning from instructional content relevant 
to their background.® These models are designed 
to reinforce foundational skills, while emphasizing 
learners’ career aspirations.** New approaches include 
contextualized vocational learning. An example that 
blends foundational skills upgrading with occupa- 
tional training is the I-BEST (Integrated Basic Educa- 
tion and Skills Training) program in the USS. state of 
Washington. An evaluation of the program finds that 
participation has positive effects on student learning, 
including course credit accumulation, persistence in 
tertiary education, and earning of occupational cer- 
tificates.” Learning community approaches, which 
emphasize multisubject instruction, project-based 
work, and learner social interactions, also are showing 
promising results. In the United States, participation 
in these programs has a significantly positive relation- 
ship with a number of factors associated with student 
success, such as level of course engagement, student 
and faculty interactions, or continuation to advanced 
courses.® 

Intensive student support can provide an institu- 
tional safety net for at-risk youth. New approaches 
showing promising results include intensive tutor- 
ing with supplemental instruction, intensive advis- 
ing, and student success courses. Intensive tutoring 
programs range from providing general academic 
counseling and tutoring to offering special skills 
training.®® Evaluations of programs offering sus- 
tained tutoring show improvements in course com- 
pletion and academic standing.” Intensive personal- 
ized advising services help students navigate course 
selection and develop career plans. These services can 
help students take advantage of other forms of sup- 
port; beneficiaries are also more likely to complete 
their remedial coursework and stay on in school after 


program completion.” Student success courses are 
usually stand-alone, credit-bearing courses for new 
students that emphasize the development of study 
skills. Experimental evidence from the United States 
shows promising results on participants’ number of 
credits earned, classes passed, and class standing.” 
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and upgrade their skills, but this remains a new area 
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Teacher skills and 
motivation both matter 
(though many education 


systems act like they don’t) 


For students to learn, teachers have to teach effectively—but many education 
systems pay little attention to what teachers know or what they do in the 
classroom. Focusing on teachers’ skills and motivation can pay off. 


After prepared and motivated learners, equipped 
and motivated teachers are the most fundamental 
ingredient of learning. Teachers are also the largest 
budget item, with their salaries accounting for over 
three-quarters of the education budget at the primary 
level in low- and middle-income countries.! Yet many 
education systems put in classrooms teachers who 
have little mastery of the subjects they are to teach— 
especially in classrooms serving poor children.” Once 
in place, most teachers take part in some professional 
development, but much of it is inconsistent and overly 
theoretical. Meanwhile, education systems often lack 
effective mechanisms to mentor and motivate teach- 
ers.3 Such failures can be illuminated through models 
of human behavior—which also point to solutions 
(table 6.1). A synthesis of the evidence in these areas 
reveals three principles that are key to achieving 
learning success through teachers: 


* To be effective, teacher training needs to be individ- 
ually targeted and repeated, with follow-up coach- 
ing, often around a specific pedagogical technique. 

* To avoid learners falling behind to the point where 

they cannot catch up, teaching needs to be pitched 

to the level of the student. 

Increasing teacher motivation with incentives can 

increase learning if the incentivized actions are 

within teachers’ capacity and if the failure to per- 
form those actions has impeded learning. 


Most teacher training 
is ineffective, but some 
approaches work 


In-service professional development requires signifi- 
cant time and resources. A survey of 38 developed and 
developing countries found that 91 percent of teach- 
ers had participated in professional development in 
the previous 12 months.* Two-thirds of World Bank 
projects with an education component in the last 
decade incorporated teacher professional develop- 
ment. Developing countries spend many millions a 
year to strengthen teachers.5 

But a lot of teacher professional development goes 
unevaluated—and much of it may be ineffective. One 
team of teacher training experts in the United States 
characterized professional development in the coun- 
try as “episodic, myopic, and often meaningless.” 
Teacher training in low- and middle-income coun- 
tries is often short and of low quality.’ Countries often 
have many training programs under way at the same 
time—in some cases dozens—with little to show for 
them (box 6.1). 

Though preservice teacher training is important 
in providing basic skills (box 6.2), evidence on teacher 
training credentials is mixed. Much of the limited 
evidence on teacher credentials, generally from high- 
income countries, indicates they have no or extremely 
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Table 6.1 Models of human behavior can guide actions to improve teaching: Some examples 


Synthesis principle 


Where this fails 


Models that identify a 
mechanism behind this failure 


Approaches that address the 
modeled mechanism 


Provide individually 
targeted and repeated 
teacher training, with 
follow-up coaching. 


Much teacher training is 
one-off, with little to no 
follow-up coaching in the 
classroom. 


Simple optimization (by 
governmeni) with information 
failure: Follow-up coaching is more 
costly than centrally delivered 
training, and centrally delivered 
training may give the impression of 
effectiveness by changing teacher 
knowledge but not practice. 
General pedagogical training 

may be cheaper than training in 
specific techniques, and evidence 
on relative effectiveness is recent. 


In India, a program with limited 
preservice but repeated follow- 
up for community teachers led to 
sizable learning gains. 


In the United States, programs 
associated with a specific 
pedagogical technique were 
twice as effective as general 
pedagogical training. 


Pitch teaching to the 
level of the student. 


In many countries, most 
students fall far behind the 
curriculum, and, facing 
large, heterogeneous 
classes, teachers have 
difficulty teaching at a 
level that allows students 
to learn. 


Information failure: Policy 
makers may have an imperfect 
understanding of how little many 
students are learning. 


Behavioral (mental models): 
Teachers may believe that lower- 
performing learners cannot 
succeed; curriculums may be 
optimistically pitched higher than 
most students can keep up with. 


In India and Kenya, reorganizing 
classes by ability improved 
learning. 


In India, complementing teachers 
with dynamic computer-assisted 
learning programs that adapt to 
learners’ ability levels improved 
math ability. Teachers receive 
explicit guidance to teach students 
at their level. 


Strengthen teacher 
motivation by 
incentivizing actions 
that are within teachers’ 
capacity and that are 
essential to learning. 


In many systems, teachers 
have few incentives 
(financial or professional) 
for good performance 
beyond their intrinsic 
motivation. 


Principal-agent: If the education 
system signals that learning is not 
valued, teachers will not have the 
same incentives as students and 
parents have. 


Teacher financial incentives have 
been effective in countries with 
high absenteeism, such as India 
and Kenya. 


Source: WDR 2018 team. 


small effects on student learning.® Simple statistical 
associations across francophone Africa suggest a pos- 
itive relationship between teacher preparation and 
student performance, but that relationship could be 
driven by other factors, such as strategic placement 
of good teachers in desirable areas (where students 
would perform well in any case).? Preparing teachers 
better is crucial, but the political economy challenges 
to doing so may be greater than for in-service training, 
and the evidence is more limited. The same principles 
that lead to effective in-service training serve as use- 
ful starting points for improving preservice training. 

Is there hope for in-service training or professional 
development? Decidedly yes. Experience from high- 
income countries shows that practicality, specificity, 
and continuity are key to effective teacher profes- 
sional development.” Practicality means teachers are 
trained using concrete methods as opposed to theoret- 
ical constructs, and the training is classroom-based." 
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Specificity means teacher training programs are most 
effective when they teach pedagogy specific to a sub- 
ject area (say, how to effectively teach a mathematics 
class). Continuity means teachers receive significant 
continual support—not one-off workshops.” 

In teacher training programs, the inclusion of 
follow-up visits in school leads to higher learning gains. 
To bridge the gap between learning new methods in 
training and implementing them in practice, devel- 
oping countries should make more use of follow-up 
visits in which trainers observe and support teachers 
in the classroom.8 In Africa, a range of programs 
with long-term teacher mentoring and coaching has 
shown sizable learning effects. In India, a program 
that provided little initial training to teachers but 
then provided support throughout the year signifi- 
cantly increased both math and language ability, with 
the largest gains for those students who were per- 
forming poorly at the outset. Teachers in Shanghai, 


Box 6.1 The landscape of in-service teacher training 


The quality of in-service teacher training varies dramatically 
across countries, but much of the training does not align 
with practices that are associated with better student per- 
formance.? One good practice of in-service teacher training 
involves follow-up visits to teachers’ classrooms to provide 
ongoing support. Among 100 teacher training programs 


Source: WDR 2018 team. 


a. Popova, Evans, and Arancibia (2016). 
b. Popova, Breeding, and Evans (2017). 


across five regions, the median number of follow-up visits 
is fewer than one per teacher. Many in-service training pro- 
grams (50 percent among a sample of programs) evaluate 
their success based on teacher knowledge at the end of the 
training; far fewer (25 percent) seek to assess their impact 
on student learning.® 


Box 6.2 What works in preservice teacher training? 


In New York City, teachers who participated in teacher 
education programs that focused on practical classroom 
work and on the curriculum of the first year produced 
significantly better results among first-year teachers than 
programs that did not.? At the same time, systems that 
have introduced alternative routes to teaching—routes 
such as Teach for America or community-teacher programs 
that skip regular preservice education—have not reduced 


Source: WDR 2018 team. 
a. Boyd and others (2009). 


b. Duflo, Dupas, and Kremer (2015); Glazerman, Mayer, and Decker (2006). 


China—where performance is high by global stan- 
dards—participate in ongoing Teaching-Research 
Groups, which provide development, mentoring, and 
peer evaluation based on classroom observation." 
Likewise, training associated with a specific ped- 
agogical technique tends to be more effective. Across 
educational interventions in the United States, pro- 
grams teaching a specific pedagogical method have 
more than twice the impact of programs focused on 
general pedagogy.” Globally, specific guidance is cru- 
cial for low-skilled teachers, who may lack the ability 
to be effective even when motivated."® At times, in set- 
tings where teachers have limited skills, this involves 
providing lesson plans that are highly scripted, outlin- 
ing concrete steps for teachers.’ Many countries will 
protest that high-quality in-service professional devel- 
opment—repeated, with follow-up visits in school, 
often around a specific technique—is beyond their 
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learning for students.’ This finding calls into question 
the value of preservice training. However, the alternative 
routes often replace preservice education with more care- 
ful selection of teachers (such as in Teach for America) or 
with more performance-oriented contracts (such as those 
for contracted community teachers). Thus preservice edu- 
cation remains important for most education systems and 
will likely yield better results with more practical training. 


budget to deliver at scale. But teachers will not learn 
without receiving high-quality teaching themselves. 
A country facing this conundrum may be better 
served by delivering high-quality training in stages 
rather than ineffective training to all in the short run. 


Helping teachers teach to 
the level of the student has 
proven effective 


In many countries facing the learning crisis, it may 
be that only students who start at the highest levels 
of learning are able to keep learning. This is in part 
because teachers tend to teach to the most advanced 
students in a class.”° These students are the easiest 
to teach, and when teachers solicit answers from 
students, the high performers are the most likely 
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Figure 6.1 Only a small fraction of 
learners keeps up with the curriculum 


Probability of a correct answer on a math test, by grade, 
relative to curriculum standards, Andhra Pradesh, India 
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Source: WDR 2018 team, using data from Muralidharan and Zieleniak (2013). 
Data at http://bit.do/WDR2018-Fig_6-1. 


to volunteer them. That leaves behind the students 
who entered the class with less knowledge. Indeed, 
Kenyan school dropouts identified that problem as a 
primary reason for leaving school. Another reason 
that many students fall behind is that in many coun- 
tries the curriculum may simply be too ambitious.” 
Teachers feel constrained to teach to the curriculum 
even when students have trouble keeping up.” 

A key principle in leaving no learner behind is to 
help teachers teach to the level of their students. This 
technique has been successful in different formats 
across a range of scenarios, whether by using com- 
munity teachers to provide remedial lessons to the 
lowest performers, reorganizing classes by ability, or 
using technology to adapt lessons. In many cases, it 
does not require a significantly greater teacher effort, 
but rather relies on restructuring classes or providing 
remedial lessons for the lowest performers. A related 
principle of effective instruction is to reach students 
by teaching them in their mother tongue (box 6.3). 

Grouping students by ability may allow teachers 
to more effectively target teaching to the levels of stu- 
dents in their classes. The theoretical effects of such 
grouping are mixed. The positive effects of better- 
targeted teaching have a potential downside: the 
adverse effect for lower-performing students of no 
longer learning from their higher-performing peers. 
Furthermore, in early grades in particular, student 
ability is not always easy to measure, so separating 
students by ability can put students on the wrong 
track. Teachers may also reduce their efforts when 
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teaching the students in the lower-performing group, 
and higher-quality teachers may be assigned to the 
higher-performing classes because these students 
may be easier to teach and so the assignment appears 
to be a reward. 

In school systems with very low learning levels, 
ability grouping has had positive impacts on both 
lower- and higher-performing students. In Kenya, 
grouping students into classes by ability led to 
improved outcomes across the board, with the high- 
est impacts among learners with more motivated 
teachers.*> In India, schools reorganized classes by 
group for just an hour a day and observed major 
gains in learning.”* Much of the rest of the evidence 
comes from the United States. Studies that relied ona 
credible counterfactual found that grouping students 
by ability either helps some students or at least has 
no adverse impact.?” In low-performing education 
systems, the lowest-performing students learn little 
to nothing (figure 6.1), so allowing teachers to target 
pedagogy may have a positive net effect. 

Another way to help teachers teach to the level of 
the student is to help them conduct better diagnos- 
tics. In Liberia, an intervention that taught teachers to 
better evaluate their students was effective, especially 
when combined with training and additional materi- 
als. So was a similar program in Malawi.” In Singa- 
pore, students take screening tests at the beginning of 
grade 1, and those who are behind in reading receive 
additional support daily.® By contrast, an interven- 
tion in India that merely provided formative evalu- 
ation was not effective; nor was another program in 
India that provided diagnostic reports and written 
suggestions on how to use the reports to strengthen 
teaching.*° Clearly, helping teachers to better under- 
stand their students’ ability levels is worthwhile, but 
if teachers lack the tools to respond effectively or the 
incentives to do so—given that teaching students at 
multiple levels is challenging—then it may not be 
sufficient. The diagnostics can work where a system 
is in place to follow up, as well as where teacher moti- 
vation is less of a binding constraint (box 6.4). 

New technologies offer promising ways to help with 
teaching to the level of the student. Computer-assisted 
learning programs can permit students to go at their 
own pace or adjust the level of instruction based on an 
initial screening test? More advanced software can 
not only screen students initially but also dynamically 
adjust questions based on ongoing performance. 
Although the overall evidence on computer-assisted 
instruction is markedly mixed, such a dynamic learn- 
ing program among secondary school students in 
Delhi, India, led to striking gains in both mathematics 


Box 6.3 Reaching learners in their own language 


Children learn to read most effectively in the language 
they speak at home—their mother tongue. In Kenya, stu- 
dents in early grades had higher reading comprehension 
when their teachers had training and materials in mother 
tongue instruction.’ Students participating in a pilot in rural 
Philippines, where they received instruction in their local lan- 
guage, showed significantly higher reading and math scores 
than students in traditional schools, which used English 
and Filipino.° In Ethiopia, students in schools affected by a 
reform to implement mother tongue instruction were subse- 
quently more likely to be in the appropriate grade for their 
age.‘ Beyond its direct learning impacts on them, students 
receiving instruction in their mother tongue are more likely 
to attend and persist in school, as demonstrated by data from 
26 countries.‘ 

The increased skill from learning to read in mother 
tongue can translate into greater skill in a second language. 
Parents and policy makers sometimes object to mother 
tongue instruction on the grounds that the mother tongue 
is not a practical language for the labor market. Yet in South 
Africa, students instructed in their mother tongue in early 
grades actually performed better in English proficiency in 
later grades.° Likewise in pilot interventions in Malawi and 
the Philippines, students instructed in their mother tongue 


also performed better in English reading later on.’ On the 
other hand, results from a first-language program in Kenya 
do not show better outcomes in the second language 
compared with a second-language literacy program only 
(though the program lasted only one year).2 

But in countries with many languages, mother tongue 
instruction can be overwhelming to implement, and a lan- 
guage “mismatch” can result in learners being left behind. 
Filipinos speak more than 180 different languages, Kenyans 
speak more than 70, and Peruvians speak nearly 100. In 98 
countries worldwide, the chance that two randomly selected 
individuals speak the same mother tongue is under 50 
percent (map B6.3.1)." In communities with a dominant lan- 
guage group, the choice of that language for mother tongue 
instruction may marginalize minority children. Even in coun- 
tries with few languages, teachers generally have little train- 
ing in mother tongue instruction, and the materials available 
for mother tongue instruction may be limited and of lower 
quality than materials in the lingua franca.’ In communities 
with multiple mother tongues, schools may divide classes 
by mother tongue, but this division can act as segregation 
Mother tongue instruction may be an unambiguous benefit 
for countries with a limited number of mother tongues, such 
as Burundi or Haiti, but the initiative still involves a major 


Map B6.3.1 Linguistic diversity around the world 
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Source: WDR 2018 team, using data from Ethnologue (2015). Data at http://bit.do/WDR2018-Map_B6-3-1. 
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Box 6.3 Reaching learners in their own language (continued) 


investment in materials and teacher training. In more diverse 
locales, governments will need to weigh the gains and the 
costs associated with mother tongue instruction against 
those of competing investments in higher-quality education 


Source: WDR 2018 team. 


a. Piper, Zuilkowski, and Ong’ele (2016). 
b. Walter and Dekker (2011). 

c. Seid (2016). 

d. Smits, Huisman, and Kruijff (2008). 
e. Taylor and von Fintel (2016). 


overall. In some cases, they may opt for better-selected and 
better-trained teachers who receive more support in teach- 
ing students at their level, regardless of the language they 
speak. 


f. Shin and others (2015); Walter and Dekker (2011). 

g. Piper, Zuilkowski, and Ong’ele (2016). 

h. Ethnologue (2015). 

i. Ong’uti, Aloka, and Raburu (2016); RTI International (2016). 
j. Metila, Pradilla, and Williams (2016). 


Box 6.4 Using diagnostic data to deliver better learning in Latin America 


Mexico’s Colima state implemented a learning improvement 
program in low-performing public schools using student 
performance on a national exam. Each school was assigned 
a technical adviser who visited schools three times a month 
to train teachers on analyzing the test information, as well as 
on understanding the reasons for poor performance. Based 
on the analysis, the adviser—working with school directors 
and teachers—developed a school-specific plan to address 
identified problems and provided follow-up support during 


Source: WDR 2018 team. 


a. de Hoyos, Garcia-Moreno, and Patrinos (2017). 
b. de Hoyos, Ganimian, and Holland (2016). 


and language. Teaching at the level of the student is 
not a novel idea, but a range of new evidence is show- 
ing how it can be implemented—even at scale—in 
developing countries. 


Teacher motivation and 
incentives make a difference, 
even with few inputs 


No amount of training or inputs can substitute for 
teacher motivation. Because of high teacher absen- 
teeism in many countries, fostering effort is a serious 
challenge. Moreover, even when they are in school, 
teachers are often not in class teaching. Yet edu- 
cation systems in many countries neither reward 
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implementation of the plan. Student performance improved 
in both language and math, but only several months 
after the program was launched.? A similar program in 
Argentina—distributing reports on the learning outcomes 
of students to public primary schools to inform teachers 
of the strengths and weaknesses of their students—also 
increased learning. Students in those schools reported that 
their teachers were more active in interacting with students 
in their classrooms and were less likely to leave early.° 


teachers for performing well nor penalize them for 
performing poorly. Teachers need to be treated as pro- 
fessionals—and good professionals receive support 
and respect, but are also held to high expectations. 
A system that does not pay attention to what its 
teachers are doing does not afford teachers the 
respect they deserve (box 6.5). 

Over the long run, the best way to strengthen 
teacher ability and motivation may be to attract capa- 
ble, intrinsically motivated people into the profession. 
In many countries and economies, the youth who plan 
to go into teaching are not among the highest academic 
performers (figure 6.2). In Finland, teaching is a cov- 
eted profession, largely because teachers receive great 
respect, are well trained, are reasonably paid, and have 
autonomy to implement teaching standards.3} Across 


Box 6.5 Would raising teachers’ salaries increase their motivation? 


In many countries, teachers are paid less than other com- 
parably educated professionals.? Would raising their sal- 
aries lead to higher motivation and better performance? 
Indonesia doubled pay for certified teachers, using a ran- 
domized controlled trial to evaluate the impact. Doubling 


Source: WDR 2018 team. 


a. Mizala and Nopo (2016); OECD (2016a). 
b. de Ree and others (forthcoming). 


many countries, average teacher pay has fallen relative 
to that of other professions. At the same time, the wage 
distribution in teaching has narrowed. High-ability 
candidates may be less attracted by a narrow pay 
structure because it gives them little opportunity to 
reap professional rewards from high performance. 
Restructuring teacher pay both to remunerate compet- 
itively and to provide returns to good performance— 
whether directly through pay or indirectly through 
promotion or retention—may improve the quality of 
candidates entering the teaching profession. But this is 
a long-term solution, not a quick fix, and even the best 
candidates need a supportive system to maintain their 
skills and effort over time. 


pay increased teacher satisfaction, but it had no effect on 
either measurable effort or student performance for existing 
teachers.° Though higher salaries could attract more capable 
candidates to the profession over time, raising salaries is no 
quick fix for shortcomings in motivation or effort. 


Better selection and retention policies will result 
in better teachers. More meritocratic hiring—say, 
based on a test instead of patronage—could improve 
student learning.*s One proposal would be to intro- 
duce a teaching apprenticeship of three to five years, 
allowing systems to identify effective teachers.% 
The least effective teachers could then be transi- 
tioned out of the teaching force. In the United States, 
proposals to phase out the least effective teachers 
suggest that the gains to learners over time would 
be substantial: replacing the least effective 7-12 
percent of teachers could bridge the gap between 
U.S. student performance and that of Finland.’ Esti- 
mates of teacher value added in other countries are 


Figure 6.2 Prospective engineers typically score higher than prospective teachers 


on PISA tests 


PISA 2015 scores for participating countries and economies, by subject and self-identified prospective occupation 


a. Mathematics 
600 


500 


Score 


400 


300 


© Prospective engineers 


b. Reading 


600 


500 


Score 


300 


© Prospective teachers 


Source: WDR 2018 team, using data from OECD (2016b). Data at http://bit.do/WDR2018-Fig_ 6-2. 
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comparable, suggesting similarly large gains around 
the world to improved teacher selection.* 

Education systems need to build accountability to 
align incentives between teachers and others. Teach- 
ers have incentives and information that are distinct 
from those of students, parents, and administrators, 
and mental models and social expectations affect the 
decisions of all actors. In the absence of accountability 
to provide motivation, teachers may minimize their 
efforts even as learners and parents wish for them 
to exert more. In Argentina and Uganda, more than 
one-third of teachers surveyed do not see themselves 
as responsible for their students’ learning; in Senegal, 
the share is more than half. 

Teacher motivation works through various behav- 
ioral mechanisms and comes in multiple forms.*? The 
fact that another person may observe their perfor- 
mance offers a form of professional motivation. So do 
evaluations, where teachers expect their performance 
to be assessed, with the associated consequences.” 
Financial incentives for successful teachers and firing 


of neglectful ones are just two important parts of a 
broader spectrum of accountability interventions. At 
the same time, teachers in many environments face 
multiple demands beyond teaching, as well as risks 
such as late payment of salaries and even physical 
danger (box 6.6). It can be tempting, in light of data 
on high teacher absenteeism and low teacher skills, 
to blame teachers for many of the faults of education 
systems. But these systems often ask far more of 
teachers than teaching—and at times offer relatively 
little in return.” 

Financial and nonfinancial incentives are one 
possible mechanism for teacher motivation. In 
India, students performed better in primary schools 
that provided teachers with financial incentives for 
higher reading and mathematics scores. Students 
also scored higher in science and social studies, 
despite no financial incentives being offered in 
those areas. Other financial incentive programs were 
successful in two districts of Kenya and elsewhere 
in India.* In the United States, by contrast, teacher 


Box 6.6 One factor undermining teaching: Poor working conditions 


Analyses of the proximate causes of lack of learning in 
low- and middle-income countries often point to teachers. 
Evidence suggests that in many countries teachers are absent 
for an astonishing number of school days and know too little 
about the subjects they are to teach. For this reason, students 
and other stakeholders may want and deserve more from 
teachers—but teachers also deserve more from the systems 
that employ them.? Over the last few decades, the status of 
the teaching profession has declined across the world in terms 
of pay, respect, and working conditions.® Because of the rapid 
expansion in access to education, teachers in developing coun- 
tries often lead oversized, multigrade classes.‘ The teacher 
shortage increases workloads and requires long working 
hours, sometimes including double shifts.4 Moreover, teachers 
often have duties outside classrooms, such as coordinating 
the activities of parent-teacher associations, running extra- 
curricular activities, and performing administrative tasks.° 


Source: WDR 2018 team. 
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Teachers in developing countries also face difficult 
working and living conditions. A lack of school infrastruc- 
ture and equipment often handicaps their efforts.’ Many 
teachers take on other jobs to support themselves and their 
families. The situation is even worse for teachers in remote 
and rural areas, who have to travel long distances to work 
and collect their salary." 

And then there are the widely implemented curriculum 
reforms that require teachers to equip students with new 
skills and employ better pedagogy, but often without 
giving teachers sufficient training and supportive teaching 
materials.' In such cases, teachers are expected to perform 
as professionals, but education systems fail to offer them 
professional development opportunities and create a pro- 
fessional culture for them! 


e. Guajardo (2011); Liu and Onwuegbuzie (2012); Luschei and Chudgar (2017). 

f. Alcazar and others (2006); Gamero Bur6n and Lassibille (2016); Urwick 
and Kisa (2014). 

g. Urwick and Kisa (2014). 

h. Gamero Burén and Lassibille (2016). 

i. Peng and others (2014); Urwick and Kisa (2014). 

j. Mooij (2008). 


financial incentives did not improve test scores in 
several states.45 However, large financial incentives 
for teachers did increase student learning in the 
District of Columbia, United States.*° In Mexico and 
Tanzania, teacher financial incentives were effective 
only in conjunction with another intervention.’’ 
One interpretation of this scattered evidence is that 
financial incentives are most likely to be effective 
when teachers can take straightforward actions to 
improve learning. In environments with high teacher 
absenteeism from school or from the classroom while 
at school, it is likely to be clear to teachers that they 
can improve learning by simply coming to school 
and spending more time teaching. Alternatively, in 
environments like that found in the United States 
where teacher absenteeism is minimal, the specific 
actions that teachers should take to improve learn- 
ing may be less obvious and less easy to implement. 
Nonfinancial incentives may include providing suc- 
cessful teachers with special recognition. Evidence 
of the effectiveness of these incentives in education 
is limited, although there is suggestive evidence in 
other sectors—for example among health workers in 
Zambia, where public recognition of worker achieve- 
ment markedly improved performance.* 

Financial incentives can also create challenges. In 
Kenya, responding to a student incentive program, 
teachers taught specifically to the test, potentially 
neglecting more holistic learning. In a teacher 
incentive program in Mexican secondary schools, a 
significant portion of the identified increase in stu- 
dent learning was attributed to student cheating.” 
In the United States, teacher cheating rose strongly 
when incentives were increased.*° And when teacher 
incentive programs are removed, the results can also 
be adverse.” 
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With financial incentives, the devil is in the details. 
Incentives can be based on teacher inputs such as 
attendance or on outputs such as student learning. 
They can be based on reaching an absolute level of 
achievement or on gains. They can be available to all 
who reach a goal, or they can be competitive across 
schools. They will vary in size relative to teacher sal- 
aries. The evidence on these design elements is still 
limited, but they merit careful consideration, taking 
into account local institutions. 

Likewise, the precise shape of a system's overall 
incentive structure will vary by context. In some places, 
financial incentives may be worth piloting. In others, 
increased community accountability may be effective. 
The mixed evidence on these interventions suggests a 
need to examine carefully the context and to test pro- 
grams locally. But while details will vary, no education 
system will be successful unless it provides incen- 
tives—whether implicit or explicit—for teacher effort. 


* KK 


Over time, education systems perform best when 
their teachers are respected, prepared, selected based 
on merit, and supported in their work. Countries 
should work toward these objectives. But in the short 
run, countries can take actions to strengthen the 
performance of teachers. They can improve the qual- 
ity of professional development, shifting resources 
to the kinds of professional development that will 
change teacher performance in the classroom. They 
can support teachers in teaching to the level of the 
student. They can provide a professional structure so 
that teachers feel motivated to apply what they know. 
Teachers are key to learners’ education. Making them 
more effective in both the short and the long run is 
an excellent investment. 
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Everything else 
should strengthen the 


teacher-learner interaction 


Investments in school inputs, management, and governance often are not guided 
by how well they improve the teacher-learner relationship. To be effective, they 


should be. 


Learners and teachers have a more productive 
learning relationship when supported by learning 
materials and other inputs. Most countries, from the 
lowest- to the highest-income, are seeking to incorpo- 
rate technology into their classrooms and education 
systems. But technology is merely the most discussed 
of a range of inputs intended to improve the teacher- 
learner relationship, from pencils and textbooks in 
the hands of learners to the walls and roofs of school 
buildings. Good school management also focuses on 
supporting students learning from teachers. Yet tech- 
nology—along with other physical inputs—often fails 
to support the work that teachers and students do, and 
the potential of school leaders and community mem- 
bers often goes unrealized. 

This chapter lays out evidence for the most effec- 
tive use of these complementary inputs in places 
where the gap between evidence and practice is larg- 
est. In many cases, the failures observed can be illu- 
minated through models of human behavior, which 
also point the way to solutions (table 7.1). A synthesis 
of the evidence in these areas reveals three principles 
that are keys to success in achieving learning through 
school investments: 


* Ensure that other inputs—including new tech- 
nology—complement teachers, thereby making 
teaching more effective. Taking this approach, 
rather than seeking to circumvent teachers, can 
increase learning. 


¢ Ensure that information and communication tech- 
nology (ICT) can be implemented in current sys- 
tems. Otherwise, it will be ineffective. 

* Recognize that school management and gover- 
nance reform, along with community monitoring, 
can achieve more learning only if they affect inter- 
action between teachers and learners. 


Technological interventions 
increase learning—but only 

if they enhance the teacher- 
learner relationship 


Technology can strengthen learning. Software can be 
highly effective if it allows students to learn at their 
own pace and, in the best cases, adapts dynamically 
to their knowledge.” A game-based computer-assisted 
learning program in Qinghai, China, intended to 
improve student language scores not only did that, but 
also improved students’ knowledge of mathematics.3 

Technology is about much more than giving 
computers to students. ICT interventions include a 
wide range of technological monitoring and infor- 
mation systems at all levels of education, from indi- 
vidual students to education systems. Computers 
and computer-assisted learning software, as well as 
online platforms such as Google Classroom, Black- 
board, and Brazil’s Education Connection, enable 


Everything else should strengthen the teacher-learner interaction | 145 


Table 7.1 Models of human behavior can guide actions to improve the effectiveness of school 
inputs and governance: Some examples 


Synthesis principle 


Where this fails 


Models that identify a 
mechanism behind this failure 


Approaches that address 
the modeled mechanism 


Additional inputs should 
complement rather than 
substitute for teachers. 


Inputs like laptops are sometimes 
used to circumvent the teacher- 
learner relationship but fail to 
deliver learning benefits. 


Information failure: Policy 
makers seek to circumvent 
poorly functioning teacher- 
learner relationships without 
evidence on an alternative 
model of learning. 


New books and materials 
have been ineffective in 
many places, but in Liberia 
they increased student 
learning when combined 
with teacher training. 


Technologies must be 
implementable in the current 
education system to achieve 
more learning. 


Education technology investments 
routinely fail because there is 
limited capacity to maintain them, 
or the infrastructure needed for 
them to work effectively does not 
exist. 


Behavioral (optimism bias): 
Policy makers project unrealistic 
technological progress. 


In India, computer-assisted 
learning has dramatically 
improved learning outcomes 
in dedicated technology 
centers. 


School governance reform 
and community monitoring 
improve learning only if they 
affect the teacher-learner 
interaction. 


Source: WDR 2018 team. 


School governance reforms and 
community monitoring often fail 
to take into account community 
capacity. 


Information failure: Community 
members often do not observe 
the most important part of 

the learning process—what 
happens in the classroom. 


In Mexico, community 
engagement over time, with 
decentralization of real 
decision-making power, has 
been effective. 


learners and parents to communicate with teachers 
about assignments and materials, and they offer 
free materials that educators and parents can use in 
designing age-appropriate development activities.‘ 
These platforms include interactive whiteboards, text 
messages to support teachers, and televised programs 
to improve instructional quality in areas with limited 
access to trained teachers. 

Though ICT offers potentially significant gains 
for education, the effects of tested interventions have 
varied greatly. Some programs have been extremely 
impressive, such as a dynamic computer-assisted 
learning program for secondary school students in 
India that increased math and language scores more 
than most other learning interventions tested there 
or elsewhere.° But others, such as the One Laptop Per 
Child programs in Peru and Uruguay, have shown no 
impact on student reading or math ability.’ Indeed, 
the vast majority of ICT interventions have had 
either no impact or—as with certain hardware inter- 
ventions—a negative impact on student learning 
(figure 7.1).® 

Moreover, current evidence likely overestimates 
the effectiveness of ICT interventions in education 
because many fail—or stumble badly—before being 
implemented. In Haiti, a program to use smart- 
phones to monitor teacher attendance had no effect 
on teacher attendance or student outcomes because 
implementation proved untenable.’ Brazil’s One 
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Figure 7.1 Information and 
communication technology has 
had a mixed impact on learning 


Distribution of the effects of education technology on 
student learning, by type 
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Source: WDR 2018 team, using data from Muralidharan, Singh, and Ganimian 
(2016, annex 2). Data at http://bit.do/WDR2018-Fig_7-1. 


Laptop Per Child initiative faced years of delays in 
several states. And a year after the laptops made 
it to classrooms, more than 40 percent of teachers 
reported never or rarely using them in classroom 


activities.” Rich countries face the same challenges: 
beyond education, almost a fifth of public sector ICT 
projects in the United Kingdom have had cost over- 
runs of more than 25 percent, and the typical project 
takes 24 percent longer to implement than initially 
expected.” It is crucial to focus on technologies that 
are truly feasible in existing systems. In rural areas, 
technology may be more attractive because of weak 
education systems, but at the same time those weak 
systems—with their limited access to electricity or 
the internet—have the least capacity to support edu- 
cation technology interventions. 

With such varied returns and so many challenges 
to implementation, why is there so much investment 
in education technology? Both principal-agent rela- 
tionships and behavioral biases likely play a role. The 
principal-agent model is relevant because public offi- 
cials may derive political returns from flashy techno- 
logical interventions, independent of their usefulness 
for better learning. Thus their personal incentives (to 
make highly visible investments) may diverge from 
the goals of students (to learn). Cognitive bias may 
also be a factor, with individuals being unrealistically 
optimistic. In fact, there is a long history of over- 
estimating the transformative nature of technology 
in schools, going back to Thomas Edison asserting in 
1913 that “books will soon be obsolete in schools. .. . 
Our school system will be completely changed in the 
next ten years.” Edison predicted that books would be 
entirely replaced by silent films.” Half a century later, 
as computers gained traction, some scholars won- 
dered if they might replace teachers at some point.” 
Of course, schools in technology-rich environments 
do look different from those elsewhere: students 
might do their work on interactive displays rather 
than on paper. But technology has for the most part 
not been particularly disruptive in education. The 
buildings, the processes of the school day, and the 
interactions between teachers and students are very 
similar to those of a century ago. 

Technologies that complement teachers work bet- 
ter than technologies that substitute for them. Many 
students have poorly prepared teachers with limited 
training and motivation, and education systems have 
been tempted to use technology to circumvent these 
teachers. Most such attempts have failed. By contrast, 
using technology to complement teachers offers 
more promise.’ Consider a computer-assisted learning 
program in Gujarat, India, that was implemented in 
two ways. One approach pulled students out of reg- 
ular classes to use computer-based math programs— 
in other words, the program substituted for regular 


class time. Students under that model performed sig- 
nificantly worse than students left with their regular 
teachers. In the other approach, where students used 
the program after school, there were sizable gains, 
especially for the poorest performers.” Another exam- 
ple of technology that complements teachers is a series 
of prepared videos of high-quality lessons—such as 
Brazil's Telecurso—which can be used in a classroom. 

Technology holds some promise in fragile set- 
tings, such as those afflicted by war or epidemic, to 
maintain a connection to formal education. During 
the 2014-15 Ebola epidemic in Sierra Leone, schools 
shut down for eight months, but the government 
launched an emergency education program with 
lessons five days a week. A 30-minute lesson over 
the radio is unlikely to have a deep learning impact, 
but this kind of program may help children stay 
connected to learning.” Sudan’s Can’t Wait to Learn 
program, which provides out-of-school children with 
computer tablets loaded with learning games, has 
shown positive learning impacts in mathematics and 
is now being tested on a large scale in areas receiv- 
ing Syrian refugees. In places where teachers are 
unavailable, such approaches may be the best option. 

Impacts on literacy and numeracy are not the only 
measures of success: technology can also promote 
digital skills. As more jobs require digital literacy, 
the opportunity to acquire those skills is an end 
in itself. Students with more access to computers 
at home have better computer skills.° And though 
Peru's One Laptop Per Child program had no effect on 
academic achievement or cognitive skills, students 
did significantly improve their knowledge of how to 
use laptops.”° In such cases, clarity of purpose is key. 
Obviously, youth need computers to learn how to use 
them. But as tools for teaching reading and numeracy, 
evidence on their usefulness is mixed. 


Other inputs bring learners 
to school—but promote 
learning only if they target 
teaching and learning 


Building schools can increase enrollment in places 
with few schools, especially for girls. In Afghanistan, 
the provision of community-based schools in just 
over a dozen communities increased enrollment 
massively, effectively eliminating the gender gap in 
enrollment.” In Burkina Faso, a program to construct 
schools with modern amenities increased enroll- 
ment by a large margin, with the biggest impacts for 
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girls. Even beyond building entire schools, building 
latrines—particularly gender-specific ones—signifi- 
cantly increased enrollment of adolescent girls in 
India.” But in places where learners have relatively 
easy access to schools, additional schools will not 
be the most cost-effective way to raise access or to 
improve learning. 

Even in places lacking infrastructure, providing 
it does not necessarily lead to more learning. The 
Afghanistan and Burkina Faso programs boosted 
learning, while India’s did not. Why? Constructing 
a school where children previously had no access 
directly alters the learning process by creating a place 
to learn that did not exist before. Building latrines 
makes school a safe space, and so it makes children 
(especially girls) better able to be at school—but 
because it does not affect what happens in the class- 
room, it may not affect learning. 

School feeding gets children to school, but it does 
not always improve learning. The most consistent 
impact of school-based meal programs has been more 
children in school, such as in Burkina Faso, Kenya, and 
Peru.” At school age, providing meals contributes less 
to brain development than earlier in the child's life, 
but it could still increase learning through improved 
attention and energy. However, if meals are offered 
during normal school hours, they reduce time on task. 
In Kenya and Peru, meals took significant time away 
from the classroom, and so they had an ambiguous 
net effect. Impacts on measured learning are mixed, 
with positive effects in Burkina Faso and Peru. 

Similarly, simply increasing the materials avail- 
able at schools does not improve learning if the 
materials do not improve teacher-learner interaction. 
Providing more textbooks in Sierra Leone in 2008 did 
not result in those books being used in the classroom 
because administrators put most of the books in 
storage—potentially to hedge against future textbook 
shortfalls. Another textbook program, in Kenya, had 
no impact on learning, most likely because most stu- 
dents did not fully understand the language in which 
the books were written. Simply providing desktop 
computers to classrooms in Colombia—where they 
were not well integrated in the curriculum—likewise 
had no impact on learning.” It seems obvious that 
resources have to be used to have an impact, but many 
interventions that provide inputs fail exactly because 
insufficient thought is given to how resources will be 
used. Infrastructure and other inputs are essential, 
but they work only when they serve the relationship 
between teaching and learning.” 
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School management and 
governance are crucial, and 
involving communities can 
help overcome incentive 
problems and information 
failures—but only if 
communities have capacity 


Schools with better management have better test 
scores. Schools vary significantly in management 
quality (figure 7.2), and school leadership plays a cru- 
cial role in school performance. Effective leadership 
means having school principals who are actively 
involved in helping teachers solve problems, includ- 
ing by providing instructional advice.” It also means 
having principals who set goals with teachers to 
prioritize and achieve high levels of learning. These 
factors are associated with the highest levels of stu- 
dent learning, and they confirm that effective school 
leadership improves the quality of teacher-learner 
interactions. A major school district in the United 
States improved student learning by training school 


Figure 7.2 Schools vary significantly in 
management quality 
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Source: Bloom and others (2015). Data at http://bit.do/WDR2018-Fig_7-2. 


Note: The school management score is a combination of 14 basic management 
practices, each rated from 1 to 5. Schools with higher scores have more 
structured management practices. 


Box 7.1 Training better school principals in Jamaica 


Training can improve the quality of school management. 
In Jamaica, the government invested in a school principal 
training program with key characteristics that likely led to 
better management. The program was based on analysis of 
principals’ weaknesses. Principals were trained to provide 
feedback to teachers on their performance, as well as to 
use data to evaluate the learning needs of students. The 
program also provided practical experience: after initial 
training, principals spent three months implementing the 


Source: WDR 2018 team. 
a. Nannyonjo (2017). 


principals in three sets of skills: how to give feedback 
to teachers on lesson plans; how to support teachers 
in regular learner assessments, as well as to provide 
feedback on action plans to improve student perfor- 
mance; and how to, through classroom observation, 
give feedback on teacher performance.?? In Mada- 
gascar, clarifying the management roles of district 
officers, school principals, and teachers and provid- 
ing them with coaching and supervision improved 
student outcomes, at least in schools where the heads 
had good performance incentives} Likewise, in 
Jamaica training and mentoring principals improved 
school management (box 7.1). 

Many countries have decentralized some elements 
of their education systems, often called school-based 
management. Providing schools and communities 
with decision-making power and resources can solve 
two problems. First, by giving local school leaders and 
parents more direct influence over teachers and other 
school representatives, it may make teachers more 
immediately responsive to student needs. Contrast 
this with supervision by a ministry of education 
representative based far away, who has little ability 
to bring shirking teachers to account. Second, schools 
and communities may have better information about 
the needs of local schools, which, along with access to 
discretionary resources, means they can more nimbly 
meet those needs. 

School-based management programs improve 
learning when the community has the capacity to 
make and implement smarter decisions.” Data on 
1 million students from 42 countries suggest that 
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program, with mentoring and coaching from experienced 
school leaders. The training modules subsequently received 
high ratings for relevance from participants. Although 
the program has not been evaluated with a comparison 
group, both the principals themselves and the teachers in 
their schools report major gains in management quality. 
Teachers say they are twice as likely to be observed in their 
classrooms and to have the principal work with them to 
develop short-term goals. 


school autonomy is beneficial to student learning in 
high-income countries but detrimental in developing 
countries.33 At the micro level, a school-based man- 
agement intervention in The Gambia improved test 
scores only in communities with high literacy rates 
among parents.*4 A similar result was observed in the 
impacts of a school grant program in Niger. Several 
of these programs did not last more than a year or 
two, in some cases because the programs were pilots 
and in others because of unstable education policies. 
Without time for communities to learn how to effec- 
tively engage in school management, impacts on 
learning are unlikely. Because communities are more 
readily able to monitor school enrollment than learn- 
ing, school-based management may increase access 
even in low-capacity communities, as happened in 
Burkina Faso.2° 

Community monitoring will not help learning if 
it does not affect what happens in the classroom. A 
range of interventions seek to increase community 
monitoring of schools by sharing school information 
with parents. The structure of these programs varies, 
from the parents themselves collecting data on teacher 
attendance or school performance, to the education 
systems disseminating prepared data to parents, to 
supplementing information with facilitated meetings 
in which parents and teachers can discuss grievances 
and lay out courses of action.” But parents are rarely 
in the classroom, and even when they are, they can- 
not necessarily identify good classroom practice. This 
may explain why the growing evidence on these pro- 
grams reveals mixed results.3* For example, in Andhra 
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Pradesh, India, providing community members with 
report cards on school performance failed to increase 
either parental engagement or student learning.* 

Successful community monitoring increases 
accountability through feedback loops between multi- 
ple stakeholders. Low-stakes accountability programs 
have improved student learning in Mexico, Pakistan, 
and Uganda.*? Though some monitoring programs 
succeed and others fail for multiple reasons, success- 
ful programs, such as those in Mexico and Uganda, 
do not reach out to only one group, but rather share 
information explicitly with school leaders and teach- 
ers, as well as with communities and parents. (The 
Pakistan experiment is an exception, focusing only on 
parents.) Parents alone cannot enact accountability, 
and better information in the hands of school officials 
helps. To improve learning, parents and communities 
need to be able to harness increased information to 
hold teachers and schools more accountable. 

School grant programs—in which schools receive 
regular influxes of resources and more autonomy 
over budget allocations—are one type of school-based 
management program. In Haiti, a program that pro- 
vided schools with grants based on the number of stu- 
dents enrolled significantly increased enrollment.” 
From this perspective, school grants can effectively 
deliver money to schools, and schools need money 
to function. But most programs that simply deliver 
grants to schools do not increase learning. Just distrib- 
uting grants to schools—as in The Gambia, Indonesia, 
and Tanzania—had no effect on student learning.” In 
Senegal, observed impacts on learning appeared only 
for a subset of children, then disappeared by the next 
year. Some school grant programs increase learning 
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outcomes only when the grants are unanticipated. 
When parents have known the grants were coming, 
they have reduced their own investments in educa- 
tion—not a recipe for long-term learning impacts.** 
By themselves, grants act in much the same way as 
other interventions that simply increase resources in 
schools. There is no guarantee that they will improve 
learning. 

But grants can be leveraged in the context of 
broader school-based management programs to 
improve school outcomes. In Tanzania, grants alone 
had no impact on student learning, but grants com- 
bined with teacher incentives did improve learning. In 
Niger, grants alone had little impact, but grants with 
training improved both student learning and parent 
support for schools.** Likewise, grants alone had no 
impact on learning in Indonesia, but they did improve 
learning when the program also linked school man- 
agement committees to village councils, seeking to 
resolve the principal-agent problem.** When grants 
are included in larger programs to encourage commu- 
nity school councils to engage in school management, 
the combination can improve learning.*’ 


*** 


Whether an education input is a physical item, such 
as a tablet or textbook, or a process, such as school 
management and leadership, it will improve learning 
only if it directly improves the quality of teacher- 
learner interactions. Without that, more inputs will 
pile onto an ineffective process and fail to have the 
desired impact. But used strategically, inputs can work 
together with prepared learners and knowledgeable, 
motivated teachers to produce high levels of learning. 
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Build on foundations 
by linking skills training 
to jobs 


After leaving school—whether as dropouts or graduates—many young people land 
jobs with limited prospects. But training offers a way out. How can successful job 
skills training programs be replicated? How can they be made available, affordable, 
and effective for the many young job seekers moving from school to work? 


Young people around the world face substantial chal- 
lenges in their transition from school to work. Many 
of them, especially youth from disadvantaged back- 
grounds, leave formal education prematurely, lacking 
the foundational skills needed to succeed on the job. In 
other words, the learning crisis manifests itself in the 
labor market. As a result, many become unemployed or 
stuck in low-wage, unstable, informal-sector jobs that 
offer them few opportunities to strengthen their skills. 
But the same can happen even to secondary school 
graduates, if they cannot fulfill labor market needs. 

When young people leave formal education, they 
usually take one of three paths to employment. Some 
join the labor market without any further education or 
training. For them, workplace training is an important 
way to build skills. Others enroll in formal technical 
or vocational training programs that build the skills 
required for specific fields or occupations of interest! 
These programs usually result in a formal technical 
qualification or an industry-recognized certification. 
Finally, a smaller group postpones looking for work or 
enrolling in further education and training. Three types 
of job training programs can help youth improve along 
these paths: 


* Workplace training can benefit both workers and 
firms, yet it is not widely available to young adults. 

* Short-term job training programs often have lim- 
ited impacts, but careful program design could help 
improve outcomes. 
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* Technical and vocational education and training 
(TVET) offers a viable path, but only when programs 
are designed and implemented in partnership with 
employers. 


Workplace training can help 
young people develop skills, 
yet few benefit from it 


Workplace training deepens workers’ skills and raises 
firms’ productivity” It can increase workers’ output 
by 10 percent or more, which is similar in magnitude 
to the payoff from investments in physical capital? In 
Latin America and the Caribbean, a1 percent increase in 
the proportion of trained workers in large firms raised 
productivity by 0.7 percent.‘ In Mexico, investments in 
training increased productivity and firm-level wages 
by 4-7 percent for manufacturing workers. Similarly, 
returns were 7.7 percent in Malaysia and 4.5 percent 
in Thailand for workers holding a secondary educa- 
tion qualification or more.° In Kenya and Zambia, 
workplace training was associated with a 20 percent 
increase in the wages of manufacturing workers.’ 
Despite its potential benefits, young workers 
rarely receive workplace training. In developing 
countries, the percentage of working-age adults par- 
ticipating in work-related training ranges from 20 
percent in urban Bolivia and Colombia to less than 
10 percent in the Lao People’s Democratic Republic 


Figure 8.1 Few benefit from workplace training, and those who do tend to already have better 


literacy or education 


Workplace training participation in last 12 months, participating countries (2011-14) 
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Source: WDR 2018 team, using data from World Bank’s STEP Skills Measurement Program (http://microdata.worldbank.org/index.php/catalog/step/about). Data at http://bit.do/ 
WDR2018-Fig_ 8-1. 


Note: Respondents were asked, “In the past 12 months, have you participated in any training courses, such as work-related training or private skills training, that lasted at least 5 days/ 
30 hours (not part of the formal educational system)?” Low proficiency is defined as level 1 and below on the literacy assessments and indicates limited understanding of texts. 
Medium to high proficiency is defined as level 2 and above and indicates the ability to integrate, evaluate, and interpret information from a variety and complexity of text materials. 


a. No literacy proficiency data available for Lao PDR; Macedonia, FYR; Sri Lanka; or Yunnan (China). 


and Vietnam.® Training participation is even lower 
for young people with incomplete education, limited 
skills, or short employment tenure.? In Peru, fewer 
than one in five young workers receive training in 
their first year on the first job.° Employers’ decisions 
to invest in training are affected by potential produc- 
tion improvements, worker turnover, and a firm’s 
overall management practices." Training participa- 
tion is lower not just for young workers generally 
(figure 8.1, panel a), but especially for young workers 
with limited literacy proficiency or education quali- 
fications (figure 8.1, panels b and c). Yet workplace 
training can be especially beneficial for young adults. 
A cross-country analysis of 38 workplace training 
studies finds an average wage increase of 7.2 percent 
for workers under 35, compared with 4.9 percent for 
workers over 35.” 

Informal apprenticeships, which can be thought of 
as informal workplace traineeships, offer young people 
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a way to upgrade their skills in a workplace setting. 
In these noncertification-granting arrangements, 
learning takes place while a young person works 
alongside an experienced craftsperson over a period 
of time.¥ Though available in many parts of the 
world, informal apprenticeships are most common in 
Sub-Saharan Africa. For example, in Benin, Cameroon, 
Cote d'Ivoire, and Senegal, informal apprenticeships 
account for almost 90 percent of the training that pre- 
pares workers for crafts jobs, as well as employment in 
some trades (such as carpentry, welding, hairdressing, 
plumbing, tailoring, masonry, and weaving). Infor- 
mal apprentices are more likely to be young people 
with limited formal education from disadvantaged 
socioeconomic backgrounds." These apprenticeships 
vary widely in their institutional setup, training con- 
tent, working conditions, and financial arrangements. 
However, most are nested within community cus- 
toms, norms, and traditions. Experimental evidence 
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on their effectiveness is scant. Evaluations from Sen- 
egal have shown positive effects on labor market out- 
comes, but limited effects on general cognitive skills." 
But early evidence from an apprenticeship program in 
Cote d'Ivoire that formalized part of the process shows 
improvements in the labor market outcomes and psy- 
chological well-being of disadvantaged youth.” 
Unlocking the potential of informal appren- 
ticeships requires up-to-date master trainers and 
recognition of apprentices’ training tenure and 
performance. Too often, master trainers lack the 
information, capacity, and incentives to adapt to new 
workplace practices. This can lead to apprentices 
learning obsolete workplace practices.’ Also, because 
informal apprenticeships are rarely recognized by 
the formal training system, they offer limited labor 
market mobility.® One way to mitigate this issue is 
to integrate informal apprenticeships into the formal 
training system, allowing for skills reengagement 
with further education and training. In Malawi and 
Tanzania, for example, competency-based skills certi- 
fication offers a pathway for young workers who have 
been apprentices to be acknowledged for their skills.”° 


Short-term job training 
offers opportunities, but 
most programs fail to deliver 


Many short-term job training programs—which usu- 
ally last between two weeks and six months—do not 
meet labor market needs. Meta-analyses of programs 
from around the world find that less than a third have 
positive, significant impacts on employment and 
earnings.” Though the estimated effects of short-term 
programs are somewhat larger in developing coun- 
tries, they remain small. Skills training that focuses 
on helping participants accumulate the human capi- 
tal needed to transition to labor markets can generate 
positive returns, but, given their short duration and 
heterogeneous quality, these short-term programs 
rarely have impacts as large as the returns from 
completing a formal education.” Many programs are 
poorly designed and implemented, or don’t interest 
the hard-to-reach young people who might need 
skills upgrading the most. The economic rationale 
for investing in training is often tenuous: in Liberia, 
for example, it can cost up to 50 times the resulting 
monthly income gain, meaning that recovering the 
investment would take 12 years.* 

But short-term training interventions do show 
some positive results when targeting disadvantaged 
groups, such as low-skilled women. In Uganda, the 
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Empowerment and Livelihoods for Adolescents pro- 
gram targeting young women shows encouraging 
impacts on graduates’ employment prospects.”> Simi- 
larly, Nepal’s Adolescent Girls Employment Initiative 
increases nonfarm employment by 13-19 percentage 
points for participants.” In the Dominican Republic, 
evaluations of Programa Juventud y Empleo, a skills 
training program that targets low-income, low-skilled, 
out-of-school youth with less than a secondary edu- 
cation, increased both employment and earnings.”’ 
Promising results from interventions in Colombia, 
the Dominican Republic, Liberia, Nepal, and Peru are 
identifying effective approaches to improving young 
women's aspirations, socioemotional skills, and labor 
market outcomes.” 

Successful short-term job training programs 
offer more than skills training. Programs that focus 
on developing multiple skills and that complement 
training with wraparound services such as career 
guidance, mentoring, and job search assistance have 
better odds of success.”® For example, comprehensive 
training schemes that emphasize technical skills, 
life skills, and internships show positive effects in 
Kenya, Brazil, and Nepal.?? In Kenya, the Ninaweza 
Youth Empowerment program, which integrates 
information and communication technology (ICT), 
life skills, internship training, and job placement 
support for youth, shows positive impacts on labor 
market outcomes. Similarly, in Brazil the Galpao 
Aplauso program has improved outcomes through a 
combination of vocational, academic, and life skills 
training. In Nepal, the Employment Fund prioritizes 
comprehensive training programs for youth who are 
underemployed or unemployed. 


TVET can prepare young 
people for work, but early 
sorting into TVET can limit 
career growth 


TVET can yield wages on par with equivalent levels 
of general education. Usually lasting from six months 
to three years, TVET can be delivered in the dedi- 
cated streams of lower secondary, upper secondary, 
or tertiary schools.3+ In Brazil, workers with upper 
secondary TVET earn wages about 10 percent higher 
than those of workers with a general secondary 
education.*® In Indonesia, returns to public TVET are 
positive for all, and greater for women.*° But despite 
encouraging results, TVET programs in many devel- 
oping countries remain an unattractive alternative 


Figure 8.2 Most vocational training students enroll during upper secondary school 


Gross enrollment rates in general education and technical and vocational education and training (TVET), lower and upper secondary students 


(circa 2010) 
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Source: WDR 2018 team, using data from UIS (2016). Data at http://bit.do/WDR2018-Fig_ 8-2. 


for young people, with often poor program quality or 
labor market relevance. 

Putting students on a technical track too early can 
limit their career opportunities for a lifetime. Young 
people need to master foundational skills—reading, 
writing, numeracy, critical thinking, and problem- 
solving—to participate meaningfully in TVET. They 
also need to be mature enough to express career 
preferences that might have long-term consequences. 
Countries that have delayed streaming into TVET have 
shown that such changes can lead to improvements. 
In Poland, delaying vocational education by a year 
improved students’ academic performance.” Problems 
with early tracking are exacerbated in systems that 
do not allow students to go back and forth between 
general and technical education, leaving technical 
graduates with limited opportunities to reengage in 
further education or training.** Despite such concerns, 
most enrollment in TVET occurs at the start of upper 
secondary school (figure 8.2). Of equal concern is that, 
in most regions, more young people are leaving formal 
education than are continuing in either general educa- 
tion or TVET—a fact that underscores the importance 
of acquiring robust foundational skills early on as a 
basis for learning on the job and throughout life. 

Developing narrow vocational skills can expedite 
workers’ transitions into the labor force, but broader 
general skills can help them adapt more easily to 
technological change. Evidence from advanced 
economies indicates that narrow technical education 


conveys early advantages in the labor market, but the 
advantages dissipate over time. Some workers end up 
outdated in their occupation-specific skills, making 
them more vulnerable to job loss.3? Though the appro- 
priate balance is bound to be country-specific, TVET 
should not lock participants into narrow occupations 
that are likely to change in unanticipated ways. 


Successful job training 
programs share several 
features 


Though the evidence available on workplace training 
and job training interventions—whether short-term 
or long-term—is limited, some features are consistent 
across successful programs. To the extent possible, 
the principles discussed in this section are distilled 
from experimental evidence. But because of the 
shortage of rigorous research on interventions in 
developing countries, this section also integrates rel- 
evant findings from different types of studies (non- 
experimental, systematic, qualitative). 


Establishing partnerships before training is 
designed 

Sectoral training programs partner learners with 
employers early and sustain their commitment.” 
These programs set up partnerships between inter- 
mediary institutions—usually network aggregators 
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@ Enrolled in vocational education 


or nonprofits with industry-specific expertise—and 
employers in an industry to anticipate job openings, 
design program content, and maximize potential 
placement. Sectoral programs focus on supporting 
individuals to enter careers rather than jobs. To do so, 
programs integrate information on career pathways 
to help participants identify the credentials that are 
needed for an occupation and that can be pursued to 
move from an entry-level job to a longer-term career.” 
Success factors include having high-quality intermedi- 
aries, along with comprehensive recruitment services, 
to generate good matches among prospective partici- 
pants, programs of study, and targeted occupations.# 
Sectoral training programs can improve labor 
market outcomes, raise productivity, and reduce 
employee turnover. Among three USS. sectoral training 
programs—Wisconsin Regional Training Partnership 
(Milwaukee), Jewish Vocational Service (Boston), Per 
Scholas (New York City)—participants saw 18 percent 
higher average earnings over a two-year period.* Sim- 
ilarly, the Year Up program, which targets vulnerable 
youth in several U.S. states, has produced high levels 
of completion, participation in internships, employ- 
ment, and earnings.** Finally, the Generation pro- 
gram—focusing on low-skilled youth in India, Kenya, 
Mexico, Spain, and the United States—has resulted in 
high job placement and employer satisfaction.*° Other 
potential approaches to engaging employers in train- 
ing include entering into public-private partnerships 
with multinational corporations, establishing effec- 
tive national workforce development initiatives, and 
fostering workplace training provision through mech- 
anisms such as training funds and tax incentives.” 


Combining classroom with workplace 
learning 

Formal apprenticeships are a common way to 
combine classroom with workplace learning; such 
programs are often referred to as “learning while 
earning.” Formal apprentice programs can last from 
one to three years and take place at the secondary or 
postsecondary level or as an alternative to upper sec- 
ondary education, giving students the opportunity to 
engage in industry-supervised workplace practices.” 
For programs targeting secondary students, special 
attention is required to ensure apprentices hone 
foundational skills, as well as occupation-specific 
skills, to avoid overly narrow specialization.*? Formal 
apprentices are typically paid less than the market 
wage.*° Good-practice apprenticeships offer structured 
training, a professional trainer to oversee appren- 
tices, a written contract that stipulates training 
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arrangements, and an assessment to verify acquired 
skills." A strong partnership between the education 
system and industry is crucial to integrate firm 
resources, share risk burdens, develop industrywide 
skill standards, and deliver apprenticeship training at 
scale. 

Studies show positive results for both firms andthe 
individuals who complete formal apprenticeships.” 
In the United States, a study looking at gains from 
secondary TVET, postsecondary TVET, and appren- 
ticeship programs in the states of Virginia and Wash- 
ington found positive gains from all three—especially 
apprenticeships.*> Studies in Canada, Germany, 
Switzerland, and the United States find that employ- 
ers recover initial apprentice costs in the short to 
medium term. In Brazil, graduates of a large formal 
apprenticeship program (Lei do Aprendiz) are more 
likely to find permanent, higher-paying jobs, with 
larger gains for less educated workers.* In Malawi, an 
innovative formal apprenticeship program targeting 
young women broadened their opportunities to serve 
as assistant schoolteachers; graduates gained higher 
skills and community standing.*° 


Identifying capable teachers 

Successful approaches to training depend on capa- 
ble teachers*’ with industry expertise who can tailor 
training to meet job requirements. Students’ gaps in 
foundational skills and lack of motivation intensify 
the complexity of teachers’ roles and responsibilities. 
The global shift toward competency-based standards 
in training, assessment, and certification amplifies 
the importance of capable, involved teachers. A study 
of 10 polytechnics in Ghana highlights the importance 
of having teachers able to offer constructive feedback 
as students work through competency modules.” 
However, often teachers lack industry qualifications 
or up-to-date pedagogical expertise, especially when 
it comes to teaching using a competency-based skills 
approach. A study of teaching practices in technical 
vocational colleges in Malaysia highlights the diffi- 
culties that teachers face in moving from assessing 
a student’s knowledge to assessing occupational and 
task-specific competency.” 

Yet in many countries, structured professional 
support is not available to ensure that TVET teach- 
ers remain current on curriculums and industry 
changes.® But they could: a review of vocational edu- 
cation systems in 10 countries in the Middle East and 
North Africa (MENA) finds active experimentation 
with innovative models to build career structures 
that reflect common norms, values, and standards to 


professionalize TVET teaching. Six of the 10 countries 
have developed occupational standards for technical 
teachers to recognize career progression, though it 
is too early to tell whether or how the new standards 
are influencing student outcomes.” Other countries, 
such as Ethiopia and Lao PDR, are experimenting 
with introducing standards and expanding the 
qualifications for technical training instructors. But 
getting robust information on program effectiveness 
is difficult because most interventions are not evalu- 
ated for impact.® 


Making student support services and 
comprehensive information available for 
decision making 
Career information is an important part of training 
programs, helping students identify opportunities, 
stay on course, and transition into a career.® Career 
information interventions are usually grouped into 
career education programs, which might include pro- 
viding direction on coursework selection, and career 
planning, which is usually provided on an individual 
basis.*’ Career information can be especially useful 
for students who lack family or social networks that 
can provide meaningful direction. Since the early 
2000s, countries in the European Union have been 
experimenting with mechanisms to integrate career 
guidance with national lifelong learning strategies 
in order to align with the Lisbon Strategy and the 
strategic framework for European cooperation on 
education and training. 

Still, evidence is limited on how career infor- 
mation initiatives affect students’ choices, training 


Notes 


1. Pre-employment job training programs can be grouped 
into (1) short-term programs of less than six months 
that focus on vocational subjects and (2) longer-term 
technical and vocational education and training (TVET) 
programs of more than six months that are mapped to 
formal education system levels. 

2. Formal workplace training refers to supervised skills 
development activity that links knowledge gained in 
the workplace with the needs of business firms (see ILO 
2010). A comparison across workplace models is difficult 
because of the heterogeneity in design, implementation, 
and effectiveness of training schemes. See Acemoglu 
and Pischke (1996); Almeida, Behrman, and Robalino 
(2012); Almeida and Carneiro (2009); Bassanini and oth- 
ers (2005); Blundell and others (1999); Dearden, Reed, 
and Van Reenen (2006); and Haelermans and Borghans 
(2012). 


trajectories, and outcomes. Career guidance poli- 
cies are a priority across 28 European countries, yet 
the scope and depth of programs vary substantially, 
highlighting the need for a well-articulated vision, 
cohesive strategy, and robust quality assurance 
mechanisms linked to funding.°® Few member coun- 
tries of the Organisation for Economic Co-operation 
and Development have program standards to mon- 
itor the quality of services, especially for programs 
delivered by private providers. This results in an 
overreliance on staff qualifications as indicators of 
quality.” 

Successful career guidance programs have clear 
objectives and outcome measurement to track pro- 
gram performance. They also have different pathways 
for participants from a diversity of backgrounds, so 
skilled career guidance staff can tailor skills develop- 
ment trajectories according to need.” 


RR 


Successful job training programs are typically based 
on strong ties with employers, with curriculums 
taught by teachers who have both industry experi- 
ence and up-to-date pedagogical expertise. These 
programs also tend to reinforce foundational skills, 
integrate classroom instruction with workplace 
learning, and offer certifications that can be further 
built on. These features keep career paths open for 
graduates. Though job training programs can yield 
positive outcomes, a key lesson is that trainees 
still need strong foundational skills—cognitive and 
socioemotional—before moving into specialized 
streams. 
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SPOTLIGHT 5 


Technology is changing 
the world of work: What does 
that mean for learning? 


The nature of work is changing. Within countries, 
jobs have been shifting across sectors—sometimes on 
a massive scale. Some shifts have been out of agricul- 
ture. In what are now high-income countries, people 
have shifted out of agriculture dramatically over the 
last half-century. In the Republic of Korea, the share 
of workers in farm jobs fell from 80 percent in 1950 to 
less than 7 percent in 2009. In Chile, the share of farm 
workers fell from 30 percent to under 15 percent in the 
same period. Other shifts have been out of industrial 
production. In the United States, the share of workers 
in manufacturing halved between 1950 and 2009. 
In low- and middle-income countries, the shift is 
ongoing. Across Sub-Saharan Africa, employment in 
agriculture is expected to drop nearly 10 percent this 
decade, with a large rise in the numbers of people run- 
ning small household businesses.” 
Technology—including digital technology—is cen- 
tral to these changes. Eighty-five percent of the 
population worldwide now has access to electricity. 
Digital technologies penetrate most corners of the 
world, with one mobile phone subscription per person 
globally, and 4 in 10 persons connected to the inter- 
net. As the World Development Report 2016 points out, 
“With rising computing power, combined with the 
connectivity and informational value of the internet, 
digital technologies are taking on more tasks.”* This 
is particularly true for routine tasks that are easy to 
automate such as a cashier's job. But other jobs—such 
as a teacher’s—are not easy to automate. Technology 
ultimately substitutes for some workers. For workers 
whose jobs are not replaced, such as hairdressers or 
surgeons, technology has varied effects. While it may 
leave the hairdresser relatively untouched, it can make 
the surgeon dramatically more productive—with 
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digital imaging, for example. And, of course, technol- 
ogy creates new jobs as well. So technology eliminates 
some jobs, creates others, and increases the returns to 
yet others.5 

The impact of technology on jobs varies dramati- 
cally across countries. For rich countries, predictions 
range from dire (in which “robot overlords” take over 
most jobs) to the much more modest estimate that 
9 percent of jobs in rich countries could currently be 
automated.® For low-income countries, where tech- 
nological penetration is much lower, the impact of 
technology on work will likely be more incremental 
(figure $5.1). Small-scale agriculture and household 
enterprises will not be automated in the near future, 
especially in countries such as Nicaragua, where less 
than 20 percent of households have access to the 
internet, or Liberia, where less than 10 percent of the 
population has access to electricity.” Those numbers 
will surely grow; greater access to technology will 
enable more poor nations and individuals to access 
those sectors that see high returns to technological 
growth. But in the short run, technology will change 
the demand for skills much more in countries that 
have the infrastructure to support automation. 

Individuals who enter the workforce with better 
technological skills will see benefits. Because tech- 
nology affects different workers in different ways, 
those who emerge from the education system with 
technological skills are more likely to be able to 
enter those professions (high-skilled, high-paying) 
that are gaining from technology.’ Around the world, 
the rise of information technology is increasing the 
demand for high-skilled graduates who can use that 
technology effectively.? That rising demand translates 
into higher wages.?° Because this dynamic can widen 


Figure S5.1 Technology use has increased dramatically over the past decade—but 


remains low in many countries 


Percentage of population who have access to electricity (2005-14) and who use the internet (2005-15), by country income group 
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inequality, ensuring that much of the population has 
access to these skills is essential. Globally, 85 percent 
of countries include computer skills in their curricu- 
lums for upper secondary school. But some regions 
lag, with Sub-Saharan Africa at only 50 percent, and 
much lower at lower levels of schooling." Beyond 
the benefits to individuals, a population with strong 
technical skills is more likely to attract international 
industries that require those skills, such as modern 
manufacturing. 

In environments with extremely limited access to 
computing technology, simple exposure can make a 
difference, but the skills that students gain are not the 
skills they need. Replacing traditional textbooks with 
laptops equipped with electronic textbooks neither 
helped nor harmed reading ability in Honduras, but in 
an environment where only 7 percent of students nor- 
mally use the internet at school, the laptops allowed 
many more of them to develop the ability to search 
for content online and do basic word processing.” 
In Romania, vouchers to purchase standard home 
computers improved very basic general computing 
skills.3 But such skills that are gained from mere 
exposure may not be the skills needed to succeed 
in the marketplace. Distributing simple laptops for 
home use in Peru made learners more competent on 
those laptops, but that did not translate to better skills 
on other, general-use operating systems (such as Mic- 
rosoft Windows).4¥ Among high school students in 


Chile, more than 90 percent used computers at school 
and two-thirds had access to computers at home. 
Although two-thirds of them were able to search for 
information online, only half could organize informa- 
tion (such as arranging folders on the computer). Less 
than one-third could produce information (such as 
writing an email with adequate content). Individuals 
need structured training in computing skills if they 
are to reap the returns of the technological revolution. 

Students entering the workforce need better crit- 
ical thinking and socioemotional skills. The ability to 
use technology is one way for them to take advantage 
of technological advancement. But another is to excel 
at those skills that technology carries out less well. 
Those include higher-order cognitive skills and inter- 
personal, socioemotional skills.° In the United States, 
jobs that require high socioemotional skills (such as 
nurses or social workers) are growing and jobs that 
require high socioemotional skills along with high 
cognitive ability (such as financial managers) are 
growing the fastest.” Education systems are begin- 
ning to learn how to cultivate socioemotional skills 
in learners: Recent efforts in Peru and Turkey have 
resulted not only in better socioemotional ability 
but also in better academic performance.'* It is not 
enough to train learners to use computers: to navi- 
gate a rapidly changing world, they have to interact 
effectively with others, think creatively, and solve 
problems. 
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All of those skills that help individuals succeed in 
rapidly changing economies are built on the same 
foundations of literacy and numeracy. It may be 
tempting to divert resources from the development 
of foundational skills into the technological skills, 
higher-order cognitive skills, and socioemotional 
skills needed in the 21st century, which seem more 
novel and exciting. But these are complements to 
foundational skills, not substitutes for them—they 
can only be built on a solid foundation. Workers can 
search effectively for digital information or create 


Notes 


. Handel (2012). 

. Fox and others (2013). 

. ITU (2016b); World Bank (20172). 

. World Bank (2016, 120). 

. World Bank (2016). 

. Arntz, Gregory, and Zierahn (2016); Drum (2013). 

. ITU (2016b); World Bank (20174). 

. World Bank (2016). 

. Autor, Katz, and Krueger (1998); Michaels, Natraj, and 
Van Reenen (2014). 

. Falck, Heimisch, and Wiederhold (2016). 

. UIS (2017). 

. Bando and others (2017). 

. Malamud and Pop-Eleches (2011). 

. Beuermann and others (2015). 

. Claro and others (2012). 

. World Bank (2016). 

. Deming (forthcoming). 

. Alan, Boneva, and Ertac (2015); World Bank (2017b). 


OMY DHNAWDHD 


it eS ees a 
SCAATDRANEO 


References 


Alan, Sule, Teodora Boneva, and Seda Ertac. 2015. “Ever 
Failed, Try Again, Succeed Better: Results from a 
Randomized Educational Intervention on Grit.” HCEO 
Working Paper 2015-009, Human Capital and Economic 
Opportunity Global Working Group, Economics 
Research Center, University of Chicago. 

Arntz, Melanie, Terry Gregory, and Ulrich Zierahn. 2016. 
“The Risk of Automation for Jobs in OECD Countries: A 
Comparative Analysis.” OECD Social, Employment, and 
Migration Working Papers 189, Organisation for Eco- 
nomic Co-operation and Development, Paris. 

Autor, David H., Lawrence F. Katz, and Alan B. Krueger. 1998. 
“Computing Inequality: Have Computers Changed the 
Labor Market?” Quarterly Journal of Economics 113 (4): 
1169-1213. 

Bando, Rosangela, Francisco Gallego, Paul Gertler, and Dario 
Romero Fonseca. 2017. “Books or Laptops? The Effect of 
Shifting from Printed to Digital Delivery of Educational 
Content on Learning.” Economics of Education Review. In 
press. 


166 | World Development Report 2018 


digital content only if they have strong literacy skills. 
They can program new online applications only if 
they have confident numeracy skills. Socioemotional 
skills like grit, which are most malleable in childhood, 
can be practiced and strengthened in the service of 
gaining strong foundational skills. Higher-order cog- 
nitive skills involve consuming information using 
literacy and numeracy skills and combining it in new 
ways. Innovations in developing 2i1st-century skills 
are much needed, but these skills work best in con- 
junction with strong foundational abilities. 


Beuermann, Diether W., Julian Cristia, Santiago Cueto, Ofer 
Malamud, and Yyannu Cruz-Aguayo. 2015. “One Laptop 
Per Child at Home: Short-Term Impacts from a Random- 
ized Experiment in Peru.” American Economic Journal: 
Applied Economics 7 (2): 53-80. 

Claro, Magdalena, David D. Preiss, Ernesto San Martin, 
Ignacio Jara, J. Enrique Hinostroza, Susana Valenzuela, 
Flavio Cortes, et al. 2012. “Assessment of 21st Century 
ICT Skills in Chile: Test Design and Results from High 
School Level Students.” Computers and Education 59 (3): 
1042-53. 

Deming, David J. Forthcoming. “The Growing Importance of 
Social Skills in the Labor Market.” Quarterly Journal of 
Economics. 

Drum, Kevin. 2013. “Welcome, Robot Overloads; Please Don't 
Fire Us? Smart Machines Probably Won't Kill Us All, but 
They'll Definitely Take Our Jobs and Sooner Than You 
Think.” Mother Jones (May/June). http://www.motherjones 
.com/media/2013/05/robots-artificial-intelligence-jobs 
-automation. 

Falck, Oliver, Alexandra Heimisch, and Simon Wiederhold. 
2016. “Returns to ICT Skills.” OECD Education Working 
Paper 134, Organisation for Economic Co-operation and 
Development, Paris. 

Fox, Louise M., Cleary Haines, Jorge Huerta Munoz, and 
Alun H. Thomas. 2013. “Africa’s Got Work to Do: Employ- 
ment Prospects in the New Century.” IMF Working 
Paper WP/13/201, International Monetary Fund, Wash- 
ington, DC. 

Handel, Michael J. 2012. “Trends in Job Skill Demands in 
OECD Countries.” OECD Social, Employment, and 
Migration Working Paper 143, Organisation for Eco- 
nomic Co-operation and Development, Paris. 

ITU (International Telecommunication Union). 2016a. 
World Telecommunication/ICT Indicators Database. 
ITU, Geneva. http://www.itu.int/en/ITU-D/Statistics 
/Pages/publications/wtid.aspx. 

. 2016b. Measuring the Information Society Report 2016. 
Geneva: ITU. http://www.itu.int/en/ITU-D/Statistics 
/Documents/publications/misr2016/MISR2016-w4.pdf. 

Malamud, Ofer, and Cristian Pop-Eleches. 2011. “Home 
Computer Use and the Development of Human Capital.” 
Quarterly Journal of Economics 126 (2): 987-1027. 


. 2017a. World Development Indicators (database). 


Michaels, Guy, Ashwini Natraj, and John Van Reenen. 2014. 


“Has ICT Polarized Skill Demand? Evidence from Eleven World Bank, Washington, DC. http://dataworldbank 

Countries over Twenty-Five Years.” Review of Economics .org/data-catalog/world-development-indicators. 

and Statistics 96 (1): 60-77. .2017b. “Peru: If You Think You Can Get Smarter, You 
UIS (UNESCO Institute for Statistics). 2017. “Curriculum and Will.” What We Do: Projects and Operations (April 25), World 

ICT in Education.” UIS, Montreal. http://data.uis.unesco Bank, Washington, DC. http://wwwworldbank.org/en 

.org. /results/2017/04/25/peru-if-you-think-you-can-get 
World Bank. 2016. World Development Report 2016: Digital -smarter-you-will?CID=POV_TT_Poverty_EN_EXT. 


Dividends. Washington, DC: World Bank. 


Technology is changing the world of work: What does that mean for learning? | 167 


PART IV Making the system work 
xe) am (=¥-]aallate ms) mecxers 1 (> 


9 Education systems are misaligned 
Vai alm oto @aliale 


s [0m Ol alar=t-) hd anan ele) lhulersme | ahvsots 
faalistolikelalaalsiaies 


1h le en KODA KOM =S<Yr~] OL =a (ON Ver (=t-] aallare mage) Oss 


Education systems 
are misaligned 
with learning 


Education systems are often poorly aligned with learning goals. These 
misalignments are driven in part by technical complexities: education systems 
simultaneously pursue many (often conflicting) goals, with the many system actors 
continually interacting in complex ways. Compounding these technical challenges 
is the limited policy implementation capacity of the many government agencies 


responsible for learning. 


Kenya's government discovered just how difficult it 
is to turn successful small-scale interventions into 
systemwide improvements in learning. In the late 
2000s, even though access to primary schooling was 
high, many children failed to acquire even basic skills. 
The government argued that large classes, with their 
overburdened teachers, lay behind these disappoint- 
ing results. But a constrained education budget meant 
that hiring more civil service teachers to address these 
problems was not an option. Instead, in 2009 the gov- 
ernment hired 18,000 temporary contract teachers. 
The new program shared many of the same features 
of an earlier pilot experiment by a nongovernmen- 
tal organization that provided government schools 
with contract teachers.’ The pilot reduced class sizes, 
leading to improved learning outcomes for students 
taught by the new contract teachers. Moreover, these 
gains were achieved at a cost well below the cost of 
the alternative of hiring more civil service teachers. 
But unlike the pilot intervention, the government 
program failed to deliver any improvements in learn- 
ing A combination of union resistance and lack of 
Ministry of Education capacity to manage contract 
teachers underpinned the program's lack of impact. 
The Kenyan teachers’ union successfully challenged 
the program in the courts, arguing that hiring 
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teachers on a contract basis violated constitutional 
rights to equal pay for equal work. The ruling led to 
guarantees from the government to gradually absorb 
all contract teachers into the civil service and provide 
them with the same employment protections. These 
developments significantly changed the employ- 
ment prospects of contract teachers. In particular, 
they weakened the link between performance and 
the chances of contract renewal—the main channel 
through which the original trial had improved stu- 
dent learning. At the same time, the ministry also 
struggled to implement the program. Government- 
employed contract teachers were paid on average 
three months late, hurting student learning. 

This example illustrates a more common finding 
that working at scale is not the same as “scaling up.”3 
Similar difficulties in changing teacher employment 
conditions in government schools have occurred 
in many other countries, despite evidence from 
pilot programs showing their potential to improve 
learning. These examples show that implementing 
interventions at scale can also induce responses from 
other actors or parts of an education system that can 
alter the potential impacts on learning. 

In many countries, education systems suffer from 
two related weaknesses. First, systems are not well 


aligned with the overall goal of learning; other goals 
can detract from, and in some cases compete with, 
efforts to improve learning outcomes. Second, the 
elements of an education system are often incompat- 
ible or incoherent. For example, government funding 
allocations sometimes fail to provide the resources 
schools need to improve learning. Even when school 
funding is available, the rules governing its use often 
leave little flexibility for schools to use it in ways tai- 
lored to the specific needs of students. 

Technical and political factors underlie these 
system weaknesses. Getting all parts of an education 
system to work together is difficult, and the agencies 
responsible for designing, implementing, and eval- 
uating education policies often lack the capacity to 
take on this role. For example, timely information on 
student learning outcomes is not available in many 
low-income countries, making it harder to design 
appropriate interventions and to monitor their 
effectiveness. The interests of system actors can also 
contribute to misalignments. For example, calls to 
devolve control over resources to schools are some- 
times resisted because private textbook providers fear 
losing out on lucrative centralized contracts.‘ 

Failure to tackle these technical and political 
constraints can trap countries in a low-learning, low- 
accountability, high-inequality equilibrium. When 
different parts of a system fail to work together, edu- 
cation outcomes will fall far short of what is possible. 
When actors in the system interact to pursue many 
goals, the mechanisms that hold them accountable for 
learning are weakened. And where powerful groups 
can divert resources to align with their own inter- 
ests, education systems can exacerbate inequalities. 
Together, these factors can pull an education system 
out of alignment with the overall goal of learning 
(figure 9.1). 


Misalignments and 
incoherence impede learning 


Taking a systems approach can help to identify the 
elements that are incoherent with each other or mis- 
aligned with learning (box 9.1). Though every educa- 
tion system faces its own challenges, incoherence and 
misalignments tend to occur across four elements: 


* Learning objectives and responsibilities. Clearly 
articulated learning goals are often missing. But 
even when they exist, the roles and responsibili- 
ties of different system actors in achieving them 
are unclear, resulting in limited accountability. 


Figure 9.1 Technical and political barriers pull 


education systems away from the goal of learning 


» 


4 


Source: WDR 2018 team. 


* Information and metrics. Accurate, credible infor- 
mation on learning is often unavailable. This 
can divert attention from learning and hinder 
monitoring and evaluation of interventions 
aimed at improving outcomes. 

Finance. Education funding is sometimes inad- 
equate and often allocated in ways inconsistent 
with a goal of providing equitable opportunities 
for effective learning. 

Incentives. The motivation and incentives of 
system actors are often only weakly linked to 
student learning. 


Learning objectives and responsibilities 

Though most education systems recognize learning 
as a central goal, it often receives less prominence 
than other objectives. Looking beyond high-level 
policy documents often reveals the objectives that 
matter most in the day-to-day affairs of education 
agencies. Bangladesh has made progress in linking 
education sector objectives explicitly to government 
budgets—for example, budget documents link allo- 
cations to specific activities aimed at improving 
education outcomes. However, the government's key 
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Box 9.1 It’s all about (education) systems 


What’s an education system? 

An education system is a collection of “institutions, actions 
and processes that affect the ‘educational status’ of citizens 
in the short and long run.”* Education systems are made 
up of a large number of actors (teachers, parents, politi- 
cians, bureaucrats, civil society organizations) interacting 
with each other in different institutions (schools, ministry 
departments) for different reasons (developing curricu- 
lums, monitoring school performance, managing teachers). 
All these interactions are governed by rules, beliefs, and 
behavioral norms that affect how actors react and adapt to 
changes in the system.® 


Why is it useful to take a systems approach? 

A systems approach takes into account the interactions 
between the parts of an education system. In doing so, it 
seeks to understand how they work together to drive sys- 
tem outcomes, instead of focusing on specific elements in 
isolation.‘ It can help assess whether different actors and 
subsystems align with education goals and shed light on 
the underlying drivers of system performance. For exam- 
ple, limited teacher capacity is often highlighted as a major 
cause of poor performance. But trials introducing contract 
teachers into schools have shown that they can deliver 
the same or better learning outcomes than government 


Source: WDR 2018 team. 


a. Moore (2015, 1). 

b. World Bank (2003). 

c. Bowman and others (2015). 

d. Bruns, Filmer, and Patrinos (2011). 

e. Newman, King, and Abdul-Hamid (2016). 


performance indicators mostly deal with access and 
completion; only 1 of the 12 indicators targets learn- 
ing. Moreover, that indicator tracks literacy rates 
in the population over age 15, which is insensitive 
to changes in school performance over the medium 
term.° 

Even where learning is a clear goal, the way edu- 
cation systems are organized sometimes hampers 
performance. Because tasks are often fragmented 
across education departments and government agen- 
cies, it can be hard to identify who is accountable for 
outcomes. In Romania, responsibilities for textbook 
provision were split among four different agencies, 
yet none of them was solely responsible for ensuring 
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teachers despite lower levels of education, training, and 
pay.‘ This finding suggests that some poor performance is 
driven not so much by a teacher’s individual capacity but 
by the organizational setting—incentives, accountability 
mechanisms, power relations—in which government teach- 
ers operate. A systems approach aims to identify these 
underlying factors so that policy design can tackle the 
deeper causes of poor performance. 

A systems approach can also highlight where system 
elements are incoherent. For example, curriculum improve- 
ments may lead to few improvements in student learning if 
other parts of the system (such as assessment or teacher 
development) fail to adapt. A systems view can reveal how 
changes in one part of the system affect other subsys- 
tems and support better alignment and ultimately better 
outcomes.* 

Asystems approach is also better suited to working with 
the complexity of education systems. The many objectives 
that education systems tend to pursue at the same time, 
coupled with the many different actors involved in pursuing 
these objectives, make it difficult to predict how different 
interventions will affect learning. A systems approach shifts 
the focus away from interventions designed to address 
specific problems, toward the broader changes required to 
improve learning sustainably. 


that schools received the right books.’ Delivering early 
childhood development services typically requires 
coordination among several government agencies, 
including health and education ministries. Managing 
these many agencies is challenging. In the early 1990s, 
constant shifts in responsibility for early childhood 
development in Ghana resulted in inadequate stew- 
ardship of these services.® 


Information and metrics 

Systems often lack the information needed to sup- 
port the design and implementation of reform. 
Education management information systems cover 
a wide range of indicators on service delivery, but in 


many countries they do not routinely include data 
on learning. India’s District Information System for 
Education (DISE) is designed to provide report cards 
for districts, but of the 980 data points reported, none 
covers student learning.’ That omission can make it 
difficult for systems to track interventions to improve 
learning, for parents to demand better services from 
politicians or directly from schools, and for agencies 
to design effective policies to improve learning. 


Finance 

Public spending does not correlate strongly with 
learning. The link between spending and learning 
differs enormously, even among countries at similar 
levels of economic development. In 2015 Peru spent 
28 percent less per student than the Dominican 
Republic, but it had Programme for International 
Student Assessment (PISA) mathematics scores that 
were more than half a standard deviation higher.’ 
More generally, cross-country correlations between 
public spending and learning levels are weak and 
statistically insignificant after controlling for income 
per capita. Moreover, for any given level of spending 
there is a wide range of outcomes. Even changes in 
public education spending over time sometimes 
result in unexpected outcomes. For example, Bulgar- 
ia’s PISA mathematics scores increased between 2009 
and 2015, despite reductions in spending per student 


(figure 9.2). Public expenditure reviews and other 
studies reveal similar patterns across subnational 
administrations and even across schools (spotlight 6). 

The weak link between spending and learning is a 
feature of the different environments in which educa- 
tion systems operate. Systems with higher corruption 
or lower bureaucratic quality are less likely to use 
resources effectively to raise learning.” 

These simple correlations also suggest that many 
education systems are delivering learning outcomes 
well below what is possible given current levels of 
funding. In India, excess teacher absenteeism in the 
public sector is estimated to cost US$1.5 billion a year. 
If teacher accountability systems were more strongly 
aligned with learning, teacher attendance would 
improve, allowing the system to achieve higher levels 
of learning at the same cost.” 

Improvements in learning are unlikely when addi- 
tional resources are allocated like past funding. The 
composition of education spending in many coun- 
tries is suboptimal. Funding for teacher salaries often 
absorbs more than 80 percent of education budgets in 
low-income countries, leaving little room for spend- 
ing in other areas. Using additional funding to shift 
spending patterns to ensure that teachers have the 
complementary inputs needed—such as textbooks 
and in-service training—would improve alignment 
and significantly aid learning. 


Figure 9.2 Simple associations between education spending and learning are weak 


a. Spending and learning outcomes 
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b. Changes in spending and learning 
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Sources: WDR 2018 team, using data from OECD (2016); UIS (2017); World Bank (2017a). Data at http://bit.do/WDR2018-Fig_ 9-2. 


Note: AUS = Australia; BGR = Bulgaria; BRA = Brazil; COL = Colombia; CZE = Czech Republic; GBR = United Kingdom; HUN = Hungary; IDN = Indonesia; 
KOR = Republic of Korea; LTU = Lithuania; PER = Peru; POL = Poland; SVK = Slovak Republic. GNI = gross national income; PISA = Programme for International 


Student Assessment; PPP = purchasing power parity U.S. dollars. 
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Incentives 

Education system actors face many incentives, but 
only some of these incentives are aligned with learn- 
ing. System actors are motivated by a range of factors 
that affect how they carry out their duties.“ Profes- 
sional rewards—the social status afforded to their 
occupation, the ability to develop new competencies, 
intrinsic motivation—are all important factors driv- 
ing behavior. Financial rewards and accountability 
mechanisms, such as feedback from parents or from 
managers, can also affect how system actors perform. 
Though some of these factors that motivate system 
actors are aligned with learning, some are not. For 
example, salaries and career progression are often 
determined largely by a combination of qualifica- 
tions and experience, despite these characteristics 
having only a weak relationship with learning. Even 
where countries have invested in mechanisms to 


evaluate teacher performance, those mechanisms are 
often disconnected from decisions on professional 
development. Edo State in Nigeria conducts annual 
performance evaluations, but these evaluations do 
not affect decisions on teacher promotions, nor do 
they lead to sanctions or rewards for teachers based 
on their performance.* 


Coherence matters: Getting all parts of the 
system working together 

Ensuring that the parts of an education system work 
together is as important as ensuring alignment 
toward learning. Even if a country has prioritized stu- 
dent learning, established reasonable learning met- 
rics, and aligned funding with incentives, it still needs 
to ensure that system elements are coherent (box 9.2). 
If a country adopts a new curriculum that places 
greater emphasis on active learning and creative 


Box 9.2 Aligning all the ingredients for effective teaching in Shanghai 


When 15-year-old students in Shanghai, China, outscored 
their peers in every other education system in the 2012 
Programme for International Student Assessment (PISA), 
they sparked global interest in figuring out how Shanghai 
did it. One lesson is that coherence among key system 
elements, all aligned toward learning, has made Shanghai’s 
teacher workforce particularly effective: 


]. Learning objectives and responsibilities. Learning stan- 
dards lay out clearly the competencies that students are 
expected to master in each grade. Teachers are expected 
to translate these standards into detailed lesson plans, 
so that students can learn the curriculum effectively. 

2. Information and metrics. Based on the learning stan- 
dards, schools routinely assess student progress. The 
results of these assessments are fed directly into the 
classroom, where teachers use them to adjust lesson 
plans and schedule additional time for areas in which 
students are weak. Student assessments are also an 
important input to a comprehensive system to monitor, 
evaluate, and support teachers. 

3. Finance. The salary and benefits package for teachers 
in Shanghai is generous compared with those in other 
parts of China. In fact, it is comparable with those of 
other professional occupations. Moreover, the salary 


Source: WDR 2018 team, based on Liang, Kidwai, and Zhang (2016). 
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scale allows high-performing and long-serving teachers 
to earn significantly more than new teachers. Adequate 
financing keeps teaching workloads relatively low, 
giving teachers the time to develop and prepare lesson 
plans. 

4. Incentives. Because of this attractive compensation 
package and the high societal respect for teachers, 
Shanghai can attract skilled, able candidates to teaching. 
Incentives—both monetary and nonmonetary—encou- 
rage teachers to maintain high standards and continue 
improving their teaching skills. For example, high- 
performing teachers are recognized through the title 
of “model teacher,” and a (small) share of a teacher's 
overall pay is based on performance. Teachers also 
have opportunities to act on these incentives, thanks 
to a well-established professional development system 
aligned with their needs. For example, school leaders 
draw on their close monitoring of teachers to develop 
targeted training plans for individual teachers. 


No two education systems are alike, and attempting to 
exactly replicate Shanghai’s system of teacher manage- 
ment in other countries is unlikely to work. Still, the core 
principle likely applies anywhere: aligning the various parts 
of the system coherently toward learning pays off. 


thinking, the curriculum alone will not change much. 
Teachers need training so that they use more active 
learning methods, and they need to care enough to 
make the change—given that teaching to the new 
curriculum could be much more demanding than old 
methods that favor rote learning. Even if teachers are 
on board with curriculum reform, students and their 
families could weaken its effects if an unreformed 
examinations system creates misaligned incentives. 
In the Republic of Korea, efforts to introduce a more 
student-centered curriculum—one that encourages 
greater creativity—have sometimes conflicted with 
pressure on students to succeed on the all-important 
university entrance examinations.” 

The need for coherence between different parts of 
an education system makes it risky to borrow from 
other countries. Education policy makers often scruti- 
nize higher-performing systems to identify what they 
could borrow to improve learning outcomes in their 
own systems. Indeed, the search for the secret ingre- 
dient behind Finland's record of learning led in the 
2000s to a swarm of visiting delegations in what has 
been dubbed “PISA tourism.” Finland’s system gives 
its well-educated teachers considerable autonomy, 
so they are able to tailor their teaching to the needs 
of their students. But lower-performing systems 
that simply import Finland’s teacher autonomy into 
their own contexts—contrary to the advice of Finn- 
ish educators who emphasize coherence—are likely 
to be disappointed. If teachers are poorly prepared, 
unmotivated, and loosely managed, then giving them 
greater autonomy will likely compound the problem. 
South Africa discovered this in the 1990s and 2000s, 
when it adopted a curriculum approach that set objec- 
tives centrally but left implementation up to teachers. 
The approach failed in many schools, in part because 
it proved to be a poor fit for the capacity of teachers 
and the resources they had at their disposal." This 
example illustrates why coherence between different 
system elements and the development of home- 
grown solutions are so important. 


Technical complexities make 
it hard to align education 
systems with learning 


Every day 23 million children—a fifth of the popu- 
lation—attend one of the 47,000 public elementary 
and high schools in the Philippines.” When their 
parents are included, about two-thirds of Filipinos 
interact with the school system on a regular basis. 


The national government in Manila manages the sys- 
tem through a network of more than 200 division and 
2,500 district education offices. These offices oversee 
over 600,000 public school teachers, or more than 40 
percent of the public sector workforce. Even routine 
tasks involve coordination between many parts of the 
system. For example, management of public school 
operational funds relies on student data from the cen- 
tral office. Once schools have their allocations, they 
issue about 500,000 checks and generate as many 
spending reports, each detailing individual spending 
items. The monitoring of these financial flows alone 
puts a significant strain on the system, even though 
they account for less than 5 percent of government 
education spending.”° 

Three characteristics of complex education sys- 
tems magnify the technical challenges of managing 
them. First, systems are opaque. Many of the goals 
pursued by these actors are hard to observe, as are 
many of the interactions among the actors, whether 
they take place in the classroom or in the bureaucracy. 
Second, systems are “sticky”: reforms to improve 
learning are hard to launch, and they take time to 
bear fruit. Third, implementing reforms successfully 
requires capacity that many bureaucracies lack. 


Many goals and actors make education 
systems opaque 

Education systems typically have a range of goals, 
including equipping students with the skills needed 
for the labor market, advancing social equity, and 
teaching children the norms, beliefs, and histories 
of their community. But education systems can have 
other goals that can hamper efforts to improve learn- 
ing. For example, politicians sometimes view educa- 
tion systems as a tool for rewarding their supporters 
with civil service jobs, or for impressing voters with 
school construction programs that are visible but not 
strategically planned. These goals can be misaligned 
with learning, leaving schools with buildings they 
cannot use and teachers who are not proficient.” 
Where these goals compete with other goals, the 
result is that the overall education system and its 
actors are not aligned toward learning. 

Managing the system to improve learning is dif- 
ficult. Promoting learning in the classroom involves 
significant discretion for teachers, who must use their 
professional assessment to tailor their teaching to the 
needs of their students. Teaching also involves regular, 
repeated interactions between students and teachers 
over a relatively long period. These characteristics— 
coupled with a dearth of information and metrics on 
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student outcomes at the school level—make it hard to 
manage and monitor learning. These challenges may 
be exacerbated if private schools are a major player, 
because those schools typically operate outside the 
direct control of the public system (box 9.3). 

Some things are easier to monitor.” School build- 
ing and cash transfer programs are highly visible and 


easily monitored investments aimed at expanding 
access. By contrast, investments to raise teacher com- 
petence or improve the curriculum are less visible, and 
monitoring their impact on student learning is more 
difficult. Such challenges can sometimes prompt edu- 
cation systems to emphasize improvements in access 
over improvements in quality.*3 Even when systems 


Box 9.3 Can private schooling be aligned to learning for all? 


Private schools play a major role in education, even for the 
poor. Globally, roughly one in eight primary school students 
attends a private school. At the secondary level, the num- 
ber rises to one in four among middle-income countries 
(table B9.3.1).2 The numbers are similar for low-income 
countries, where they may be underestimates if informal 
schools are undercounted.° In some places, the share of 
students attending private schools is much higher than 
these global figures. In one Nigerian state, 57 percent of 
all basic education learners attend private schools.‘ These 
enrollments are not limited to high-income households. 
In slum communities in Nairobi, Kenya, 43 percent of the 
poorest quintile of families send their children to private 
schools. This is higher than the proportion among the rich- 
est quintile of families in nonslum communities who send 
their children to private schools (35 percent). In Jamaica, 
10 percent of learners from the poorest economic groups 
enroll in private schools.° 

Low-income households are willing to make this sac- 
rifice because they perceive that private schools deliver 
better education at comparable cost. In many countries, 
parents say that teacher absenteeism is lower in private 
schools and that learning outcomes are better.’ In Jamaica 
and South Africa, parents suggest that private schools are 


safer than public schools.? Furthermore, although public 
primary education is formally free in the vast majority of 
countries, many informal fees remain, reducing the cost 
difference between public and private schools. 

But there is no consistent evidence that private schools 
deliver better learning outcomes than public schools, or the 
opposite. In Colombia, India, and the United States, exper- 
imental evaluations of the consequences of enrolling in a 
private versus a public school show mixed results." In some 
contexts, private schools may deliver comparable learning 
levels at lower cost than public systems, often by paying 
lower teacher salaries.' Even so, lower teacher salaries may 
reduce the supply of qualified teachers over time. 

Much of the evidence cited in this debate is nonexper- 
imental, so it may conflate the effects of private schools 
themselves with the effects of the type of students who 
enroll in private schools. Comparisons across 40 countries 
that seek to adjust for these differences in student char- 
acteristics find no private school advantage in the vast 
majority of countries.! Moreover, little rigorous research has 
assessed the effects of private schooling on students’ values 
or on the long-term health of the public school system. 

From a public policy perspective, how should gov- 
ernments view the growth in private schooling? Should 


Table B9.3.1 Private providers account for a significant share of school 


enrollment 


Percentage of learners enrolled in private education, by country income group (2014) 


Country income group Preprimary Primary Secondary 
Low-income 57 14 20 
Middle-income 42 13 25 
High-income 42 12 20 


Source: World Bank (2017a). 
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governments encourage its growth, whether by removing 
restrictions on new schools or even by providing public 
subsidies that allow more students to enroll in private 
schools? Is there a trade-off between the short-term 
growth of private schools and the long-term health of the 
education system? 

Private schools offer a variety of potential benefits. A 
straightforward one is proximity: new private schools can 
fill a gap when the nearest public schools are far away, 
or when there is demand to expand faster than public 
infrastructure can be built.* As for cost, in China, Ghana, 
and Kenya some private schools are comparable in cost to 
the public alternative.' Private schools can also innovate 
in ways that public schools cannot because they operate 
under fewer constraints. Moreover, private schools can ful- 
fill niches for families with preferences different from the 
government’s—for example, if parents value single-sex or 
religious education. Private schools may also have lower 
rates of teacher absence, such as in four countries in Sub- 
Saharan Africa.” In those schools, nonperforming teachers 
can be let go more easily than in public schools, increas- 
ing their accountability. Finally, competition from private 
schools could improve the performance of nearby public 
schools." 

But these benefits come with many risks. Private 
schools may skim off the higher-income students who 
are easiest and most profitable to teach, leaving only the 
more disadvantaged students in the public system.? Private 
schooling may also deepen social cleavages along dimen- 
sions other than income if it causes students to be sorted 
by language, ethnicity, or religion. Because families are 
not necessarily knowledgeable about pedagogy, private 
schools can induce them to make choices that slow student 
learning—for example by discouraging mother tongue 
instruction. And because families cannot evaluate quality 
or learning perfectly, private providers may try to take 
advantage of them to increase profits or achieve their other 
goals. Finally, even if the expansion of private schooling 
brings short-term benefits, it can undermine the political 
constituency for effective public schooling in the longer 
term. It is impossible to make any global statement about 
whether the benefits or risks dominate. 

Experience with public-private partnerships is growing. 
As governments face their own limited capacity to cope 
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with the learning crisis, some have turned to public-private 
partnerships in which they provide private schools with 
resources. In Pernambuco, Brazil, the state government 
is seeking to place half of the state’s students in govern- 
ment-funded private schools. In Uganda, the government 
provided hundreds of private schools with the resources 
needed to meet the growing demand for secondary edu- 
cation.? In some cases, this means private providers essen- 
tially mirror public schools in terms of education policy, 
such as in the government-“aided” schools in India.’ But in 
other cases, such as in voucher schools in the United States 
or Liberia’s Partnership Schools pilot, publicly funded pri- 
vate schools have significant leeway in how they run their 
schools, letting student learning results be the measure of 
quality.® In Uganda, public resources increased the quality 
of private schools, and public-private partnerships are 
likely a useful strategy if countries seek to expand enroll- 
ments dramatically in a short time." 

But overseeing private schools may be no easier than 
providing quality schooling. The key challenge for policy 
makers is to develop a policy and regulatory framework 
that ensures access for all children, protects families from 
exploitation, and establishes an environment that encour- 
ages education innovation. Managing a regulatory frame- 
work to achieve this is difficult: the same technical and 
political barriers that education systems face more gen- 
erally come into play. From a technical perspective, devel- 
oping a framework to accommodate the diverse nature 
of nonstate provision is complicated. In Bangladesh, for 
example, there are 11 separate categories for the nonstate 
provision of presecondary education (figure B9.3.1). Unlike 
government schools that are relatively homogeneous, 
nonstate provision reflects many different philosophies or 
approaches to education. The capacity of education agen- 
cies to effectively align incentives and monitor services 
is often limited, and assessing quality in contexts where 
education is provided in very different ways requires added 
skills. Though neither is easy, governments may deem it 
more straightforward to provide quality education than to 
regulate a disparate collection of providers that may not 
have the same objectives. 

The bottom line is that countries need to ensure that 
private schooling does not undermine learning for all. 
Different countries make different choices on private 
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delivery, acting on a variety of motivations. But if they do 
allow or even encourage private schooling, they need to 
remain alert to all the risks just outlined. The problems out- 
lined in this Report do not disappear simply because of a 


change ina delivery mechanism. Governments may choose 
to contract out some service delivery, but they should never 
contract out the responsibility for ensuring that all children 
and youth have the opportunity to learn. 


Figure B9.3.1 In Bangladesh, there are 11 different kinds of 
nonstate providers of presecondary education 


Number of institutions under each nongovernment provider of presecondary 


education (2016) 


Kindergarten 


BRAC learning centers 
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Source: WDR 2018 team, using data from Directorate of Primary Education, Bangladesh (2016). Data at http:// 


bit.do/WDR2018-Fig_B9-3-1. 
Note: NGO = nongovernmental organization. 


Source: WDR 2018 team. 
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to monitor student learning are effective, they can 
sometimes lead to biases toward better-performing 
students, short-term test preparation, or a narrow 
focus on subjects that are explicitly tested. 

The multiplicity of actors and institutions in an 
education system makes the outcomes of efforts to 
improve learning unpredictable.* Learning is a com- 
plex process that is difficult to break down into simple 


178 | World Development Report 2018 


oe 


Heyneman and Stern (2014). 

. Bold and others (2017). 
de la Croix and Doepke (2009); Kosec (2014); Sandstrém and 
Bergstrém (2005). 

o. Akaguri (2014); Harma (2011). 

p. “Educacdo Integral,” Secretaria de Educa¢do, State of Pernambuco, 
Varzea, Recife, Brazil, http://www.educacao.pe.gov.br/portal 
/?pag=1&men=70. 

q. Barrera-Osorio and others (2016). 

r. Kingdon (2017). 

s. Economist (2017). 

t. Barrera-Osorio and others (2016). 


linear relationships from cause to effect. The multiple 
interactions that characterize teaching and learning 
and the almost continuous feedback that they provide 
can result in teachers, parents, and students adapting 
their behavior in unpredictable ways. For example, 
the introduction of school grants in Andhra Pradesh, 
India, and in Zambia failed to improve student learn- 
ing in the long term because parents reduced their 


financial support in anticipation of the increase in 
government funding.*s Reducing the financial burden 
on parents may be a desirable effect of these grants, 
but it was not their primary intent. More generally, 
many factors outside the classroom and the school 
system, including health and economic shocks, can 
alter the impact of interventions aimed at improv- 
ing learning. Failure to learn and adjust policies in 
response to such changes often means that interven- 
tions do not work as planned. 


Education systems are “sticky” 

Education systems are slow to change. Some of the 
best-known successes in reforming systems, such as 
in Chile or Finland, took decades from initiation to 
fruition. Even at the micro level, such as in schools 
in the United States that enacted comprehensive 
school reform, it took 8-14 years for the full effects to 
be felt.2* These long time frames present two further 
challenges to better aligning education systems with 
learning. First, to improve learning, policies usually 
have to remain relatively consistent. This is difficult 
under normal circumstances: changes in government, 
volatile funding, and shifts in the overall economic 
context all threaten the sustainability of policies.”” But 
staying the course is even more challenging when 
the reforms fail to show any benefits in the short 
run. Second, the long lags make program evaluation 
more difficult, because attributing improvements to 
specific interventions is especially challenging when 
their impacts emerge only in the long run. 


Implementation capacity to improve 
learning at scale is often lacking 

Opacity and stickiness make technical alignment hard 
enough to achieve; weaknesses in implementation 
capacity make the task even more daunting. Success- 
ful implementation depends on effective leadership, 
coordination between education agencies, and imple- 
mentation teams that are motivated, use resources 
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efficiently, and can troubleshoot in real time—all of 
which are in short supply in many systems. Moreover, 
behavioral economics highlights many cognitive pit- 
falls that policy makers commonly face in complex 
operating environments. These include difficulty in 
evaluating policy effectiveness when faced with too 
many options; loss aversion, or the tendency to feel 
failures more intensely than successes, which makes 
policy makers wary of experimentation; biases that 
lead to selective use of information to reinforce exist- 
ing views; and relational bias, which makes it harder 
for officials with elite educational backgrounds to 
grasp the challenges of mass education. 

Education agencies often lack the capabilities 
needed to deal with these complexities.” A recent 
assessment shows how multitasking and fragmen- 
tation within education agencies can blur lines of 
accountability for learning. In Cyprus, because of the 
absence of a department for human resources and 
general administration, pedagogical departments had 
to manage these responsibilities, diverting time from 
developing programs and policies.*° Public expendi- 
ture and financial accountability assessments also 
highlight the low capacity in many developing coun- 
tries in key areas. For example, only about half of the 
72, low- and middle-income countries assessed since 
2010 had any system in place to ensure that resources 
intended for schools, health clinics, and other service 
delivery units reached the front lines. 


KKK 


Technical challenges and lack of implementation 
capacity result in misaligned education systems. 
When countries are unable to overcome these chal- 
lenges, their education systems deliver levels of learn- 
ing far below what is possible. But tackling the techni- 
cal barriers to better learning is only part of the battle. 
To break out of low-learning equilibriums, countries 
must also address the political constraints that are 
often at the heart of these technical misalignments. 
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SPOTLIGHT 6 


Spending more or 


spending better—or both? 


Good teachers, conducive learning environments, reliable assessment systems, 
and innovative learning technologies all cost money. And as more students 
progress further in school, financing needs will rise. Yet more funding leads 

to better learning only if it is used well, with an intentional focus on learning 


outcomes. 


Patterns of public education 
spending 


Decisions over how to allocate public spending inevi- 
tably require difficult trade-offs. When deciding how 
to spend scarce resources, governments have to weigh 
the costs and benefits of different spending decisions, 
both of which are typically estimated with large mar- 
gins of error. Governments also have to weigh the 
short- and long-term benefits of different spending 
choices. Should they spend more on urban infra- 
structure improvements to reduce air pollution in the 
future, or should they invest today in better primary 
health care services to treat respiratory infections? 
Spending on education is subject to this same 
calculus. Education's many potential benefits for both 
individuals and societies (see chapter 1) make it a 
strong candidate for public support. In fact, the obliga- 
tion to provide equitable education is often enshrined 
in law. Although the high returns to education mean 
that many students are willing to bear the costs them- 
selves, there are strong rationales for public financing 
of at least some parts of the education system. First, 
a concern for fairness induces countries to subsidize 
education for children and youth from the poorest 
households, because their families may be unable or 
unwilling to finance their education. Second, because 
education has positive spillovers for others—such as 
when it reduces the propensity to commit crime— 
individuals may underinvest in their own education, 
from society’s perspective. Third, governments want 


to use education to create shared values; delivering 
education directly, or at least financing it, gives them 
leverage to ensure this happens. But in all these cases, 
governments must weigh benefits against the costs 
of investing in education rather than in some other 
area—and they must decide how to spend within the 
education sector. 

As their spending patterns show, countries are 
increasingly willing to invest in education. Whether 
because of the public economics calculations just dis- 
cussed or for other political reasons, countries have 
devoted a rising share of their national income to edu- 
cation (figure S6.1). In 2012 about two-thirds of coun- 
tries that reported information on spending devoted 
over 4 percent of national income to public spending 
on education. Education also typically absorbs the larg- 
est single share of a government's budget, averaging 
about 15 percent of the budget across low- and middle- 
income countries. In some countries, the investment 
in education is still low, indicating scope for further 
prioritization, but the aggregate trends suggest that 
governments recognize the importance of education. 


Does more spending 
improve learning outcomes? 


While there is a strong rationale for public invest- 
ment in education, the relationship between spend- 
ing and learning outcomes is often weak. In global 
learning assessments, for example, although higher 
per-student spending initially appears to lead to more 
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Figure S6.1 Governments devote a large share of their budgets to education 


a. Government education spending as 
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Source: UNESCO (2015). Data at http://bit.do/WDR2018-Fig_S6-1. 
Note: Median values are shown. GNP = gross national product. 


learning at the poorer end of the global income scale, 
the correlation largely disappears once controlling for 
countries’ per capita income. This finding suggests 
that the correlation is driven more by economic devel- 
opment than by the level of public spending. 

Regional learning assessments—which include 
many more low- and lower-middle-income countries— 
also show how inconsistent the association between 
spending and learning can be. For example, public 
spending per primary school student increased over 
the 2000s in both Kenya and Lesotho; yet student 
learning outcomes improved in Lesotho but declined 
in Kenya (figure S6.2, panels a and b). Guatemala 
improved student learning significantly between 
2006 and 2013, even though per-student spending 
declined over the same period (figure S6.2, panels c 
and d). Comparing across regions within a country 
often reveals similar patterns. In Indonesia during 
the 2000s, the link between changes in district edu- 
cation spending and secondary school examination 
results was very weak.’ These findings indicate that 
education systems, and even schools within the same 
system, vary in their ability to translate increased 
spending into better learning outcomes. 

Providing more resources directly to schools 
has also had mixed effects on learning in different 
environments. A review of two decades of research 
reveals that the association between many school- 
level resources (such as textbooks) and student 
outcomes is variables School grants have become 
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b. Government education spending as percentage 
of total government spending (1999 and 2012) 
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a commonly used mechanism in many countries to 
provide schools with the resources needed to support 
school improvement. Although grants have often 
increased student enrollment and retention, they 
have had relatively limited effects on learning. For 
example, recent evaluations in Indonesia and Tanza- 
nia found that school grants alone did not increase 
student learning.* 


Weak links in the 
spending-learning chain 


There are five main reasons why spending does not 
always lead to better and more equal student learning 
outcomes: 


* Spending is not allocated equitably. 

¢ Funds do not reach schools or are not used for their 
intended purposes. 

* Public spending can substitute for private spending. 

* Decisions on the use of public funding are not 
coherently aligned with learning. 

* Government agencies lack the capacity to use fund- 
ing effectively. 


Public spending is often allocated in ways that exclude 
poor and marginalized children, reducing its over- 
all impact on learning. Overall, public education 
expenditure tends to favor wealthier, more powerful 
groups (table S6.1). Poorer households do tend to 


Figure S6.2 The relationship between changes in public 
education spending and student learning is often weak 


Changes in public education spending and in sixth-grade mathematics learning outcomes, 


selected countries 


a. Changes in public 
education spending 


SS 5004 ne 
a -_———" 
= 4004 
2 
> 
B 3004 
8 
m 2005 
= 
2 1004 
o —_—_hh—™, 
o 
a 0. 
T T T 
2000 2005 2010 
— Kenya — 
c. Changes in public 
education spending 
& 1,400 - 
a 
& 1,200 4 
2 
= 
n 
= 1,000 4 
om 
D 
£ 800-7 
= 
c 
2 
wn 6007 
2006 2010 2014 
— Guatemala 


b. Changes in sixth-grade 
mathematics learning 
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Sources: WDR 2018 team, using data from UIS (2016) for spending and from World Bank (2017) for student 


learning. Data at http://bit.do/WDR2018-Fig_S6-2. 


Note: Per student spending is reported in purchasing power parity (PPP) U.S. dollars. Student learning data are 
derived from data collected by the Southern and Eastern Africa Consortium for Monitoring Educational Quality 
(SACMEQ) and the Latin American Laboratory for Assessment of the Quality of Education (LLECE). For each 
country, the two plotted data points reflect the years for which data are available. 


receive a greater share of public spending on primary 
education because they tend to have more children 
than wealthier households. But public spending on 
secondary and tertiary education overwhelmingly 
favors wealthier groups, because by the time students 
reach those levels, many of the poor have already left 
school. In Zambia, 39 percent of secondary education 
spending was allocated to the richest fifth of house- 
holds, compared with only 8 percent for the poorest. 
The gap is even wider at the tertiary level, where 86 
percent of all public spending is captured by the rich- 
est households. These estimates likely understate the 


differences across socioeconomic groups, since they 
typically do not account for the fact that students 
from poorer families tend to receive lower-quality 
schooling than those from wealthier families. Allo- 
cating resources more equitably could therefore raise 
average learning levels. 

Public funds sometimes fail to reach schools or are not 
used as intended. In 2013-14, almost a third of school 
capitation grants failed to reach Zambian primary 
schools.° In the Philippines, in 2013 about a quarter 
of similar funds did not reach primary and lower 
secondary schools.’ In Zambia, funds were diverted 
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Table S6.1 Inequalities in public education spending are common 


Incidence of public education spending by household income quintile, selected countries and years 


Percent 
Primary Secondary Tertiary Total 

Country Year(s) Poorest Richest Poorest Richest Poorest Richest Poorest Richest 
Bangladesh 2010 Dif 13 13 23 2 55 20 20 
Burundi 2006 23 13 12 27 4 59 15 29 
Congo, Rep. 2011 21 16 18 18 ] 62 = = 
Ghana 2007 19 13 13 20 4 65 12 34 
Honduras 2004 31 6 5 20 ] 67 a = 
Indonesia 2007 26 1] 15 19 4 57 20 23 
Pakistan 2007-08 25 11 16 23 9 55) 17 28 
Thailand 2011 25 14 a —_ ] 73 20 26 
Uganda 2009-10 19 15 6 38 ] 68 a rc 
Zambia 2010 22 14 8 39 0 86 15 31 

Sources: Bangladesh: World Bank (2013a); Burundi: Tsimpo and Wodon (2014); the Republic of Congo: World Bank (2014); Ghana: Wodon (2012); Honduras: Gillingham, Newhouse, and 


Yackovlev (2008); Indonesia: Wika and Widodo (2012); Pakistan: Asghar and Zahra (2012); Thailand: Buracom (2016); Uganda: Guloba (2011); Zambia: World Bank (2016b). 


Note: Poorest (richest) refers to the poorest (richest) 20 percent of households. Estimates for secondary in Ghana and the Republic of Congo are for lower secondary. Primary estimates for 
Thailand also include secondary. — = data not available. 


for other uses, including to fund district-level operat- 
ing costs. In the Philippines, while district education 
offices reported using some of the funds to pay school 
expenses, this use was not recorded and schools 
had no way of monitoring the spending. Schools 
in the Philippines that served poorer students also 
received a smaller share of their intended allocation 
than schools serving wealthier students.’ Even when 
resources are delivered to schools, they are sometimes 
not used. In Sierra Leone, a 2008 program success- 
fully increased the delivery of textbooks to schools, 
but the textbooks had no impact on learning because 
they were stored as a hedge against future shortfalls 
rather than distributed to students.? 

Household spending can also affect the link between 
public spending and outcomes. Taking account of house- 
hold spending on education can alter the picture 
of overall spending across countries. Government 
expenditure as a proportion of gross domestic prod- 
uct (GDP) in Nepal is much lower than in Vietnam. 
However, when all public and private spending on 
education is taken into account, spending in Nepal is 
much higher.” Households can also react to increases 
in public education spending by lowering their own 
contributions. For example, the introduction of school 
grants in India and Zambia had no effect on learning 
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because parents reduced their own financial support 
in anticipation of increased government funding." 

Decisions on how to use public resources often lack 
coherent alignment with learning. The evidence on ways 
to improve learning is growing, suggesting ways to 
use funding more effectively. Also important is ensur- 
ing that the mix of inputs and interventions that are 
funded work together well. Many education systems 
find this difficult. For example, more classrooms may 
be built, but there are insufficient funds to hire the 
teachers needed to use them. Teachers are present 
in classrooms, but they lack the learning materials 
needed to teach effectively. Improving coherence 
is not just about the mix of inputs, but also about 
the systems that manage these inputs. In Tanzania, 
grants given to schools were ineffective on their 
own, but combining grants with teacher incentives 
ensured the grants were used effectively to improve 
student learning.” In Indonesia, school grants 
improved learning only when they were combined 
with measures to link school committees with village 
authorities. 

The government agencies responsible for managing edu- 
cation often lack the capacity to use resources effectively. The 
Philippines recently embarked on an ambitious edu- 
cation reform backed up with significant increases in 


public investment. A central element of the program is 
the introduction of two additional years of secondary 
education, which in turn requires the rehabilitation 
and expansion of school infrastructure to provide the 
places needed for senior high school. Despite a 19-fold 
increase in the infrastructure budget between 2005 
and 2015, lack of government capacity to manage 
such a massive school building program has meant 
that a large share of the resources remained unspent. 
In 2014 only 64 percent of the infrastructure budget 
was committed. And even where classrooms were 
built, school principals have been largely unsatisfied 
with their quality.’ 


Spending to improve 
learning 


Achieving education goals, whether national or 
global, will certainly require more spending in the 
coming decades. The Education Commission esti- 
mates that low- and middle-income countries will 
have to increase spending by 117 percent between 
2015 and 2030 to enable most children to complete 
primary and secondary education with minimum 
levels of learning, as the Sustainable Development 
Goals call for. Reliably estimating such global costs 
is difficult because doing so requires accurate infor- 
mation on many aspects of country systems that is 
often unavailable. It also requires making assump- 
tions—for example, about optimal class size—that, 
while valid for some countries, may not apply to 
others. Notwithstanding these difficulties, exercises 
of this kind offer useful information on what school 
expansion of reasonable quality might cost. That 
information indicates that, even with greater effi- 
ciencies, it will be impossible to extend schooling for 
hundreds of millions of students without investing 
more in education. 


Notes 


. See chapter 9 and Altinok (2010). 

. World Bank (2013p). 

. Glewwe and others (2011). 

. Mbiti, Muralidharan, and Schipper (2016); Pradhan and 
others (2014). 

. See Filmer, Hammer, and Pritchett (2000) for a similar 
analysis of health spending. 

. World Bank (2016c). 

. World Bank (2016a). 

. See Policy Note 5, figure 8 in World Bank (2016a). 

. Sabarwal, Evans, and Marshak (2014). 
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The key will be to use those additional resources 
in ways that improve learning, especially for disad- 
vantaged children. Costing exercises are sometimes 
misinterpreted as implying that more spending is all 
that is needed. But because there is no certainty that 
spending will lead to better outcomes, spending bet- 
ter will also be essential—as the Education Commis- 
sion emphasizes. When education is funded using 
resources diverted from other pressing public needs 
such as health or infrastructure, or funded through 
debt to be repaid by the next generation, it is crucial 
that spending be oriented toward what will improve 
learning for all. How to achieve this is the focus of this 
World Development Report. 

Spending more can be an important first step 
to spending better, but, again, increasing spending 
alone is not sufficient to improve learning. The 
politics of education reform sometimes requires 
compensating stakeholders who might lose out, 
or spending more to lay the foundations for future 
reform. For example, addressing the low pay of teach- 
ers in Peru was an important prerequisite for intro- 
ducing the reforms (such as linking teacher career 
paths to performance) that underpinned improve- 
ments in learning outcomes. However, in other 
cases strategies of this kind have worked less well. 
A 2006 education finance law in Argentina aimed at 
reversing declines in quality led to a near-doubling of 
education spending as a share of GDP (from 3.5 to 6 
percent) between 2005 and 2013. The new resources 
were used to increase teacher hiring, raise teacher 
pay, and improve school infrastructure. Yet despite 
these improvements in inputs, learning outcomes 
have improved only marginally in recent years and 
are still below 2003 levels.’ These experiences high- 
light the need to strengthen the links in the spending- 
learning chain, if more spending is to lead to better 
learning outcomes. 


10. UIS (2016). 

uu. Das and others (2013). This may be beneficial if it reduces 
financial burdens on parents, but that was not the pri- 
mary purpose of these grants. 

12. Mbiti, Muralidharan, and Schipper (2016). 

13. Pradhan and others (2014). 

14. World Bank (2016a). 

15. This includes only projected costs of primary and second- 
ary education. See Education Commission (2016, table 3). 

16. Bruns and Schneider (2016). 

17. de Hoyos, Holland, and Troiano (2015). 
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Unhealthy politics 
drives misalignments 


Politics can intensify misalignments in education systems, when the vested interests 
of stakeholders divert systems away from learning. This can happen at various stages, 
from setting policy goals to designing, implementing, evaluating, and sustaining 
reforms. Even when many individual actors are committed to learning, a system can 


remain stuck in a low-learning trap. 


Education systems are complex. Aligning an educa- 
tion system's goals, financing, and incentives with 
student learning is difficult for technical reasons. But 
there are also political reasons systems do not prior- 
itize student learning. Political impetus to fix mis- 
alignments can help achieve important educational 
objectives—as it has in Chile, England, and India (see 
chapter 11)—but unhealthy politics can make things 
worse. Too often, education interventions, whether 
big reforms or day-to-day implementation steps, are 
compromised because powerful individuals or groups 
can make others act in ways that serve private inter- 
ests rather than the collective good. Powerful actors 
frequently benefit from the status quo and devise 
mechanisms to preserve it, regardless of the impact 
on system performance. These mechanisms result in 
actors being trapped in low-learning equilibriums. 


Unhealthy politics can 
intensify misalignments in 
education systems 


Many education systems encounter political imped- 
iments and rent-seeking, making alignment much 
harder to achieve. Consider these examples: 


* Using computers to educate students requires dif- 
ficult technical decisions on program design. But 


even when there is consensus on technical design, 
students may not benefit. For example, in 1996-97 
the superintendent of New York City’s District 
29 rigged a $6 million contract, awarding it to a 
computer company affiliated with a politically con- 
nected property developer. In return, the company 
gave the superintendent expensive gifts, while 
delivering archaic or nonfunctioning computers 
to students. Teachers had been counting on decent 
computers to help their students in math; without 
the computers, the students lost out. 

In 2009 Mexico's federal government introduced 
a plan for competitive recruitment of teachers, 
whereby all candidates were required to take a test 
covering content knowledge, pedagogical mastery, 
and ethics. Designing the tests was technically dif- 
ficult. But the technical challenges paled next to the 
political impediments created by local affiliates of 
Mexico's teachers’ union, the Sindicato Nacional de 
Trabajadores de la Educacion (SNTE), which has 1.4 
million members. The policy change meant that the 
opportunity for patronage-driven hiring would van- 
ish. Because of strong opposition from the SNTE, 
the reform was diluted, making it applicable only 
to a small pool of vacancies. Estimates suggest that 
up to 85 percent of hiring in 2010 was discretionary 
rather than competitive. Recent evidence indicates 
that the teachers hired through discretionary 
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methods were much less effective at improving 
student learning than those hired competitively. 

* Vyapam (http://wwwvyapam.nic.in) is the 
government-run professional examination board 
in Madhya Pradesh, India. It conducts large-scale 
entrance tests for admission into courses such as 
medicine and for recruitment into state government 
jobs such as the police. Designing entrance tests 
and ranking candidates are technically challenging 
when there can be more than 100,000 candidates. But 
political economy factors intrude as well: recently, 
rent-seeking is alleged to have undermined the goal 
of fair, transparent admissions. In 2013 an indepen- 
dent probe exposed a potential multibillion-dollar 
scheme in which senior politicians and government 
officials had allegedly set up a system allowing 
unqualified candidates to pay bribes, often to middle- 
men, to receive high rankings in entrance tests.* In 
2015, the Supreme Court of India transferred the case 
from the state government to the country’s premier 
investigative agency, the Central Bureau of Investiga- 
tion, which is currently pursuing the investigation. 


Education systems involve many stakeholders with 
multiple, often contradictory, interests.5 These systems 
are not just about students, teachers, or principals. 
They also involve politicians, bureaucrats, the judi- 
ciary, private players, and more. Participants linked to 
these institutions have a vested interest in how the sys- 
tem works, including its structure and funding. A text- 
book supplier may want to provide a quality product, 
but it also cares about profits. A politician may want 
to make teachers accountable for student learning, but 
also realizes the electoral risks of teacher opposition. 
A bureaucrat may support meritocratic admissions, 
but also accepts a “token of appreciation” for ensuring 
the admission of an acquaintance’s child to a desirable 
school. A parent may want to complain about a teacher, 
but worries that her child could suffer retaliation. 

Vested interests are not confined to private or 
rent-seeking interests. Actors in education systems 
are often driven by their values or ideology, especially 
when the consequences of education policies are not 
readily apparent. Examples include a commitment to 
public schools versus public-private choice, secular 
education versus religious, and accountability for 
test scores versus a focus on teacher qualifications. In 
addition, education systems can be used by dominant 
ethnic groups—especially in multilingual or multi- 
religious societies—to promote their positions while 
suppressing minorities. 

Multiple interests jeopardize learning goals. Bal- 
ancing multiple interests is difficult. When education 


190 | World Development Report 2018 


interventions threaten interests, whether they be a 
person's financial, ideological, or status-related inter- 
ests, resistance from different parts of the system can 
be expected. The net effect: the system is pulled away 
from a focus on learning (figure 10.1). 

Education systems are vulnerable to political inter- 
ference because they are opaque and because teachers 
constitute a large base of government employees. The 
opacity of education systems, coupled with uncer- 
tainty about how a specific education policy will affect 
learning, is fertile ground for contestation of reforms. 
Teachers—the most important factor in learning— 
have traditionally been important grassroots political 
actors, because of their geographic spread and regular 
interaction with parents. Two characteristics make 
teachers especially attractive as patronage appointees. 
First, entry costs to the profession are often low. Sec- 
ond, the impact of incompetent patronage appointees 
on learning is not immediately visible, so it has few 
reputational consequences for politicians, especially 
if they are already operating on a short time horizon.‘ 

Because of the size of the teaching force, teach- 
ers’ unions can be politically important. The political 
power of a union depends on how effectively its leader- 
ship can mobilize teachers, which varies widely within 
and across countries. In many countries, not all teach- 
ers are union members or engaged in union activity.’ 
Whether union activity helps or hinders education 
reform ultimately depends on several factors (box 10.1). 


Multiple actors and interests: 
Pulling the system out of 
alignment at each 

step of the policy cycle 


Personal interests influence reform at every step. 
Vested interests—of teachers, principals, bureaucrats, 
politicians, parents, students, the judiciary, civil soci- 
ety organizations, the private sector—are influential 
at every step of the education policy cycle. Broadly, 
these steps are setting policy goals, designing poli- 
cies, implementing policies, evaluating policies, and 
sustaining policy reforms. The forces that detract 
from alignment tend to be magnified in conflict set- 
tings (box 10.2). 


Setting policy goals 

In many cases, policies are not chosen for their 
effectiveness in improving learning. Often, they are 
guided instead by the vested interests of powerful 
actors. Policies to hire teachers tend to be popular 
with politicians, teachers, and parents because they 


Figure 10.1 Contradictory interests detract from learning objectives 


Source: WDR 2018 team. 


Box 10.1 How do teachers’ unions affect learning? 


Teachers’ unions are important institutions for protecting the 
rights of teachers, but do they matter for student learning? 
The quantitative literature identifies situations in which 
unions may have undermined high-quality teaching and 
learning. By fighting for higher salaries while protecting 
incumbent teachers from outside competition, unions some- 
times stifle the formation of an effective teaching cadre.* 
A study in India finds that union membership is negatively 
correlated with student achievement. However, hidden 
behind large-scale correlations is evidence of union behavior 
that has been beneficial for education reform efforts, includ- 
ing efforts by the Zambia National Education Coalition, the 
Uganda National Teachers’ Union, and the Confederacion 
Nacional de Maestros de Educaci6n Rural de Bolivia. 


It is impossible to say that unions always help or harm 
student learning; it depends on their characteristics and 
behaviors, as well as the context in which they operate. All 
countries have unions, but they vary in membership and 
number. Figure B10.1.1 shows the wide variation in teacher 
unionization across countries. Some countries, such as 
Finland and Mexico, have one dominant teachers’ union, 
whereas others, such as India and South Africa, have several. 

There are also institutional variations in teachers’ unions, 
such as differences in internal organization, stability, and 
party affiliation. In the United States, some have argued 
that teachers’ unions resist education reforms because 
union leaders represent the median teacher, and if leaders 
supported these reforms, they would be voted out.‘ On the 


(Box continues next page) 
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Box 10.1 How do teachers’ unions affect learning? (continued) 


Figure B10.1.1 Teacher unionization varies across countries 


Union membership as a percentage of total teachers, selected countries (2012-15) 
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Source: Shrestha (2017). Data at http://bit.do/WDR2018-Fig_B10-1-1. 
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Note: Bars represent the ratio of union members to teachers. In Mexico, because the union includes a sufficient number of retirees and nonteaching staff, 


the ratio exceeds 100 percent. 


other hand, evidence from Argentina and Mexico suggests 
that union behavior (and ability to resist reform) depends 
on the influence of partisan identities, organizational 
fragmentation, and the competition for union leadership.‘ 


In summary, the outcome of union behavior will depend 
on how the proposed reform aligns with the interplay 
of a union’s goals, quantitative strength, stability, and stra- 
tegic alliances. 


Sources: WDR 2018 team, based on: Carnoy (2007); Eberts and Stone (1987); Hoxby (1996); Kingdon and Teal (2010); Moe (2001, 2011); Murillo (1999, 


2012); Shrestha (2017). 


a. Hoxby (1996). 

b. Kingdon and Teal (2010). 
c. Moe (2011). 

d. Murillo (1999). 


bring visible, immediate benefits. Likewise, large- 
scale school construction programs tend to attract 
considerable support. In a diverse range of countries 
(Cambodia, Colombia, Mozambique), policy makers 
have invested in building preschools instead of in 
less visible but more effective process-oriented early 
childhood initiatives, such as programs to improve 
parent-child interactions. In Bangladesh, until recently 
it was much easier to unite elites around the need for 
mass education than around raising educational stan- 
dards in schools.* 

It is also difficult to adopt a policy goal that threat- 
ens or reconfigures jobs, as is true for most quality- 
enhancing education policies. For example, an alter- 
native to the politically popular policy of reducing 
class size would be to introduce serious teacher 
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performance appraisal, accompanied by tools to help 
teachers improve. Yet, because such reforms could 
expose poorly performing teachers, the reforms rarely 
reach the policy arena. Other policies that threaten 
teaching jobs include school consolidation or closing. 
Such policies have been difficult to implement, because 
parental support for local schools makes it politically 
infeasible to close small, high-cost rural schools.’ In 
Bulgaria, school principals have been reluctant to let 
teachers go, despite declining school-age populations. 
In several countries, strong teachers’ unions have pre- 
vented large-scale teacher redundancies.” 


Designing policies 
Even when the goal of a policy is to improve stu- 
dent learning, its final design often reflects what 


Box 10.2 How politics can derail learning in conflict-affected states 


Conflict-affected regions face important political economy 
constraints in developing their education systems. Violent 
conflict hampers learning in an immediate sense when 
schools, students, and teachers are targeted, and also 
over the long term when security issues divert attention 
and resources from schools. The “security first” approach 
often hides the vested interests in the security sector— 
powerful military and political actors, as well as external 
political interests—which have agendas that overshadow 
development. 

Policy in politically weak or fragile conflict-affected states 
can be influenced by both external and internal power rela- 
tions. External aid agencies are often handicapped by the 
difficulty of delivering aid in violent or insecure contexts. This 
difficulty usually leads to an emphasis on generalized educa- 
tional frameworks rather than context-specific ones because 


of the security challenge of examining and addressing local 
differences during a violent conflict. Domestic considerations 
create challenges as well, as in decisions about the medium 
of instruction in schools. For example, approaches that 
guarantee the right of all children to be educated in their 
“own” language can be used by vested groups to segregate 
communities, as happened in Bosnia and Herzegovina in 
the 1990s. Political economy challenges can also occur within 
healthy democracies that have conflict regions. Insurgency- 
affected parts of Chhattisgarh, India, have found it difficult 
to implement education reforms aimed at improving teacher 
accountability and student learning. A key concern has been 
an overall lack of funding, payment delays, and interruption 
of teachers’ pay. Reduced funding may steer systems toward 
employing patronage hires, allowing less qualified and often 
uncertified teachers to replace trained teachers. 


Sources: WDR 2018 team, based on: Bensalah (2002); De Herdt, Titeca, and Wagemakers (2010); Magill (2010); Mosselson, Wheaton, and Frisoli (2009); 
Novelli and others (2014); Rose and Greeley (2006); Shields and Rappleye (2008). 


powerful interests want, which can undermine the 
goal. Decentralization policies aim to increase policy 
responsiveness and accountability, but many times 
they delegate accountability for results without the 
authority or resources to achieve them. In Indone- 
sia, Pakistan, and some Latin American countries, 
major decentralization efforts have struggled (at 
least initially) to find the right balance between cen- 
tral and local funding, or between central and local 
authority." Central authorities often attempt to limit 
the power of lower units of government because 
local governments—being closer to the people—can 
threaten the political power of more distant govern- 
ments. At the same time, local governments may be 
unwilling to assume greater responsibility or adopt 
national norms—for example, on the inclusion of 
marginalized groups. 


Implementing policies 

Policy makers may face little resistance when sign- 
ing off on a policy, but implementation can be com- 
promised if the policy threatens powerful interests. 
Policies designed to measure teacher performance 
have been particularly difficult to implement. In 
2000 South Africa’s (then) Department of Education 
introduced the National Policy on Whole-School 


Evaluation to establish standardized procedures for 
monitoring school performance and establishing 
the support needs of schools.” Though the policy 
was meant to be supportive, premised on building 
collaborations and mentorship, the South African 
Democratic Teachers’ Union—the country’s largest— 
remained opposed to it. Many of the union's chap- 
ters blocked the adoption of the policy in schools in 
their areas. A similar situation occurred in Mexico 
in 2012.8 

Well-intentioned reforms may threaten the legal 
entitlements of individuals—and when, understand- 
ably, they turn to the courts for redress, reforms risk 
being stalled. In Peru, unions resisted a new law on 
teacher evaluations by challenging its constitutional- 
ity.4 The ensuing court process then delayed imple- 
mentation of the first round of evaluations. Though 
the court eventually upheld the law, for political 
reasons the union was given a major concession: the 
law applied only to newly hired teachers. Similarly, in 
2002 teachers in Andhra Pradesh, India, stalled imple- 
mentation of a policy on teacher transfers by filing a 
court case. 

Parents can also make it difficult to implement 
learning-focused policies. A common example is 
parents helping children to cheat on examinations, 
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which makes it hard to measure student learning. 
In 2015 the global media broadcast images of family 
members in Bihar, India, handing cheat sheets to 
children inside a building taking exams.’® Perhaps 
parents are aware that their children have not learned 
much in school, leaving them uncompetitive against 
better-prepared or more affluent children. 


Evaluating policies 

Indicators of the effectiveness of policies are often 
chosen in a way that lets powerful groups off the 
hook. When a policy fails, frontline bureaucrats 
or principals may face repercussions regardless of 
whether failure was in their control. As a result, deci- 
sions on what to measure and track are less a reflec- 
tion of what the education system values than of who 
is willing to be held accountable for what. For exam- 
ple, India’s landmark Right to Education Act (Act No. 
35, 2009) did not originally contain any measure of 
teacher effectiveness or of student learning (although 
subsequent rules and amendments have sought to 
introduce the quality dimension). Similarly, accred- 
itation systems in higher education tend to focus 
on inputs—such as number of classrooms, amount 
of equipment, or faculty-student ratios—instead of 
what students have learned or whether they become 
employed.” Such an approach limits liability, but jeop- 
ardizes learning goals. 

Data can be manipulated. Even when indicators 
track meaningful variables, data quality may be com- 
promised. Data on outcomes can be gamed; decisions 
on who collects data and how often are made using 
subjective criteria. Gaming might take the form of 
candidates hiring test takers, parents facilitating 
cheating, teachers misreporting student test scores, 
or government officials encouraging teachers to mod- 
ify test scores.’ In several countries, comparisons of 
national enrollment data with household survey data 
find systematic discrepancies, with official statistics 
sometimes exaggerating progress.” 

A subtler barrier to effective monitoring and 
evaluation is when governments collect mountains 
of data but not in a format that facilitates decision 
making. In some countries, the many efforts to col- 
lect data on indicators create the illusion that policy 
makers are actively engaged in data-driven decision 
making to improve school quality. But by the time 
data entry is completed, it is time for the next round 
of data collection. No serious analysis is conducted, 
feedback is not provided to schools, or the data are too 
broad to be useful.”” Such instances devalue data in 
decision making. 
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Sustaining policy reforms 

Even when difficult reforms are implemented, they 
can be undone. Reversal can be incremental, with 
policy makers softening elements to appease specific 
groups. In the late 1990s, the government of Madhya 
Pradesh, India, began hiring teachers from the newly 
created shiksha karmi cadre, under which all new teach- 
ers were to be locally recruited and put on 10-month 
contracts. In response, teacher applicants filed court 
cases arguing that the policy violated their constitu- 
tional rights, which emphasize that no citizen can be 
ineligible for office based on criteria such as place of 
birth. Burdened with litigation and pressure, the gov- 
ernment redesigned the policy, making concessions 
on local recruitment and qualifications.” Similarly, 
in Sao Paulo, Brazil, reforms of teacher career tracks 
introduced in 2009 were gradually undone by 2011 
under a new education minister.” 

Reversal can be sudden. In Ghana, an early child- 
hood care and development body was set up under 
the office of the president, with high-level support. 
But a change in administration put the office under 
the Ministry of Gender, Children, and Social Protec- 
tion, lowering the priority and visibility given to early 
childhood issues.”3 In Republica Bolivariana de Ven- 
ezuela, decades of reforms that had created a strong 
higher education system were reversed when a new 
populist government set the goal of universalizing 
higher education. That effort, without prepared stu- 
dents, adequate faculty, or the appropriate infrastruc- 
ture, has weakened the country’s education system. 

These cases raise two important issues. First, why 
do parents and students have such a limited voice 
in influencing the vested interests that jeopardize 
quality-enhancing reforms? It could be that those most 
likely to benefit from reforms—especially parents and 
students—are often poorly organized. Moreover, the 
immediate gains of any proposed policy tend to be 
uncertain, making it harder to mobilize support for the 
reform. Parents may also find that the potential ram- 
ifications of opposing a teacher or politician could be 
formidable for their children. By contrast, those who 
stand to lose from reforms tend to be better aware of 
their losses and, in many cases, are better organized for 
collective action.” 

Second, more generally, why do these low-learning 
equlibriums persist? For every teacher, bureaucrat, 
politician, judge, or businessperson who jeopardizes 
learning, there are several who feel deeply account- 
able for student learning and act to strengthen edu- 
cation systems. Yet individual actors find it hard to 
escape these traps. Why? 


Trapped in low-accountability, 
low-learning equilibriums 


The formal rules of the game—that is, the laws 
and policies governing education systems—already 
reflect power asymmetries.” When specific policy 
goals are chosen, when finance is allocated to certain 
tasks, when teachers’ unions bargain for concessions, 
preexisting power asymmetries and struggles are 
expressed through policy. 

But such decisions also reveal the informal con- 
tracts that determine which formal rules are chosen 
or followed. Unwritten codes of conduct derive from 
the values, expectations, and cultural norms in a 
social setting, and they are important in determining 
the extent, nature, and strength of politics in that set- 
ting.” In Indonesia, where older colleagues are treated 
with considerable courtesy, school mergers have often 
been delayed informally until principals who stood to 
lose their jobs retired.”* In rural Rajasthan, India, field 
research finds that teachers often have to pay bribes to 
get needed services, such as a transfer. Interestingly, 
the norm differs by gender: male teachers make the 
payments directly, while female teachers typically go 
through a male relative.” 

The widespread operation of informal networks 
reveals a lack of generalized trust within systems. 
Unwritten codes of conduct between individuals 
can thrive only if there is sufficient trust between 
them. Each must trust that the other will behave as 
expected. Yet as individuals cultivate personalized 
trust-based relationships—often undermining learn- 
ing or equity goals in the process—overall trust in the 
system suffers.> 

As systems grow more complex and the number 
of actors and interactions increases, uncertainty 
multiplies. Trusting others becomes increasingly dif- 
ficult. Creating reciprocal obligations helps manage 
the uncertainty. These obligations do not need to be 
spelled out; the social setting ensures they are under- 
stood. During the Suharto era in Indonesia, teachers 
were required to display “mono-loyalty” to the state 
and teach compulsory courses in the state ideology, 
Pancasila.” If they did not, they knew they risked 
demotion or transfer to schools in undesirable areas. 
In SNTE-dominant parts of Mexico, teachers knew 
that if they did not support the SNTE, they risked 
unfavorable transfers or being sidelined. 

Reciprocal obligations complicate accountability. 
Power relations between entities and groups depend 
on context. One group may be more dependent on 
another—and therefore less powerful—in one context. 


Figure 10.2 Interdependencies characterize the 
relationship between teachers and politicians 


Promise of 
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Job or desirable transfer 


Source: WDR 2018 team, based on Béteille (2009). 


But in another context, dependence patterns could 
reverse. In 2007, when teachers in Rajasthan threat- 
ened the ruling party with electoral sabotage, they 
were the ones who wielded power, with the ruling 
party dependent on them for victory. But in another 
context at the same time, the ruling party controlled 
individual teachers through patronage-based appoint- 
ments and transfers (figure 10.2). Because these 
opposing relations occurred simultaneously, the 
distinctions between who was more dependent and 
who was accountable to whom became blurred.33 Such 
interdependencies govern relationships between 
various participants in education systems, such as 
parent-teacher or bureaucrat-middleman interactions. 

Interdependencies can become coercive and 
entrenched. This happens when actors are unable 
to break out of informal contracts. In the Vyapam 
case in Madhya Pradesh, India, several bureaucrats, 
fearing adverse career repercussions, allegedly joined 
the scam, making it much worse than otherwise 
possible. Then others joined—with middlemen pur- 
portedly profiting off the connections made between 
the various players. What started out as a small-time 
operation allegedly became institutionalized (albeit 
informally) as people began to believe they would lose 
out if they questioned the status quo.3+ Likewise, in 
New York City the unwritten power of school board 
members forced superintendents and principals to 
routinely allow wasteful practices. This pattern 
repeats itself across cases, countries, and time. 

As participants get trapped in unhealthy inter- 
dependencies, they devise mechanisms to protect 
themselves from undue blame and punishmen—and 
avoid taking risks. Fearing repercussions for uncoop- 
erative behavior, actors make choices that provide the 
appearance of change—for example, when a politician 
presides over school openings but does not address 
teacher absenteeism, a judge delays case hearings 
endlessly, or a parent sits on a dormant school com- 
mittee. These actors become averse to taking risks or 
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innovating. Such behavior coexists with a perverse 
form of information management. For fear of being 
wrongly implicated in illegal behavior, officials some- 
times generate mountains of paper, files, and data, 
paralyzing the system instead of providing relevant 
information.* The opacity, stickiness, and low capac- 
ity of education systems make it easier to exaggerate 
accomplishments and cover up performance problems. 

Abdicating responsibility and avoiding blame 
erode an education system's ability to function, 
thereby perpetuating a low-accountability, low- 
learning equilibrium. Teachers, bureaucrats, judges, 
or politicians who fail to cooperate with the status 
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quo are likely to put themselves at considerable pro- 
fessional risk. The system leaves them little choice 
but to conform. The problem is not limited to specific 
individuals, but arises from the multiple interests of 
actors and the underlying incentives in education 
systems. The accountability needed to ensure student 
learning becomes secondary. 


*** 


This is the story of unhealthy politics.3” Healthy pol- 
itics can generate the momentum for reform and 
deliver results for education outcomes, as chapter 11 
shows. 
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How to escape 
low-learning traps 


Tackling the technical and political constraints that misalign education systems 
requires action on three fronts: investing in better information on learning; 
mobilizing coalitions for learning; and adopting a more iterative, adaptive 


approach to change. 


Since 1995, England has substantially improved the 
literacy and numeracy skills of primary schoolchildren 
using good political strategy and sound technical solu- 
tions.’ As a result, the proportion of students in grade 4 
reaching the intermediate benchmark in the Trends in 
International Mathematics and Science Study (TIMSS) 
assessment of mathematics shot up from 54 percent 
in 1995 to 80 percent in 2015 (figure 11.1)—an achieve- 
ment matched by few other countries.” Poor education 
outcomes had become an important issue in the 1997 
national elections, and the new government responded 
with a national strategy at the start of its term in 1998.3 

At the heart of the reforms was a redesign of how 
teachers taught. The new strategy set clear targets for 
the country, as well as for individual schools, based 
on regular, publicly available data on student achieve- 
ment. The targets provided incentives for local educa- 
tion authorities, teachers, and principals. The govern- 
ment adjusted school inspections to reflect the new 
curriculum; it also strengthened the links between 
teacher performance and pay. A revamped profes- 
sional development program, supported by local liter- 
acy consultants, helped teachers implement the new 
strategy. Local governments received substantial new 
funding for implementation. Literacy and numeracy 
“hours,” introduced as part of the new strategy, sig- 
nificantly improved early learning outcomes.* The 
program has continued to evolve, with more support 
focused on disadvantaged learners. 


Reforms that improve learning rely on good 
strategies—both political and technical. This chapter 
draws lessons from various experiences to identify 
how opportunities for reform emerge and how poli- 
ticians, bureaucrats, parents, and students can seize 
them. It focuses on three entry points for addressing 
systemic political and technical challenges: improving 
information, building coalitions and strengthening 
incentives, and encouraging innovation and agility. 
Most countries need all three. 


Improving information 


Addressing weaknesses in education systems is dif- 
ficult when accurate, usable information on learning 
is lacking. Without it, stakeholders cannot hold pol- 
iticians and bureaucrats accountable, assess system 
performance, or design effective policies to improve 
learning. Though it might not be enough on its own, 
better information on learning can provide the sub- 
stance needed for better political strategies and the 
evidence base needed for effective policies. 


Information can increase political 
incentives to improve learning 

The absence of information on learning can weaken 
the political incentives to provide good public ser- 
vices. Targeted programs or even direct vote buying 
are sometimes exchanged for political support, 
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Figure 11.1 Primary school numeracy has increased dramatically in England 


TIMSS mathematics scores for grade 4 students, and share of students reaching the intermediate benchmark in TIMSS 
mathematics assessment 


b. Students above and below the 
intermediate benchmark, England 


a. Average scores for grade 4 students 
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Source: WDR 2018 team, using data from Trends in International Mathematics and Science Study (TIMSS), 1995-2015 (https://timssandpirls.bc.edu/). Data at 
http://bit.do/WDR2018-Fig_11-1. 


Note: Students at the intermediate level are able to apply basic mathematical knowledge in straightforward situations; demonstrate an understanding of 
whole numbers and some understanding of fractions; visualize three-dimensional shapes from two-dimensional representations; and interpret bar graphs, 


pictographs, and tables to solve simple problems. 


resulting in poor service delivery.> Better information 
can encourage voters to elect politicians who deliver 
results.© For example, using a metric that combines 
student passing rates with test scores, the federal 
government in Brazil sets credible education targets 
that are widely scrutinized (box 11.1). Meeting these 
targets increases the chances of an incumbent poli- 
tician being reelected and of bureaucrats keeping 
their jobs.’ This example also highlights the value 
of providing information on learning for areas that 
correspond with political jurisdictions; because of 
the overlap, citizens can hold politicians accountable 
for progress on education targets. But whether infor- 
mation can shift incentives toward a greater focus on 
learning depends on the broader context. For exam- 
ple, better information in just one sector is unlikely 
to disrupt patronage networks in countries where 
clientelism is entrenched across the political system. 


Information can also improve incentives in 
schools 

Information on school performance can make local 
education systems work better. In many developing 
countries, parents have limited information on the 
quality of their local schools. In Pakistan, providing 
parents with information on learning outcomes 
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increased competition between schools. As a result, 
learning outcomes improved in both public and pri- 
vate schools, and private school fees were cut.’ Par- 
ents can also use information to pressure schools to 
raise standards.? For example, the provision of report 
cards has strengthened accountability in some coun- 
tries.’° Interventions of this kind work best where 
power relations between actors in an education sys- 
tem are not highly unequal or organized to support 
patronage networks, and where frontline service 
providers have autonomy to respond to community 
demands." When these factors prevent parents’ voices 
from being heard, it can encourage some, especially 
middle-class parents, to opt out of the public educa- 
tion system, weakening pressure on governments to 
improve learning across the system.” 

Information can also help ensure that resources 
go where they are intended. In the mid-1990s, schools 
in Uganda received only around a quarter of their 
intended per student grant allocations. The govern- 
ment began to publish information on the timing 
and amount of transfers made to districts for school 
capitation grants so that schools could monitor local 
administrators. This move increased the share of grant 
funding reaching schools by reducing capture of fund- 
ing by district offices. Consistent with the feedback 


Box 11.1 Using information to align incentives with learning in Brazil 


From 2000 to 2012, Brazil’s learning outcomes on the 
Programme for International Student Assessment (PISA) 
showed steady improvement, with gains in some sub- 
jects concentrated among poorer-performing students. 
Underlying this progress were reforms that strengthened 
accountability for system performance, reduced funding 
inequalities across Brazil’s diverse regions, and provided 
cash transfers to the neediest families. Improvements in 
information underpinned these reforms. 

Better information made it much easier to hold edu- 
cation agencies accountable for learning. A state-level 
learning assessment introduced in 1995 was extended 10 
years later to cover all fourth- and eighth-grade students. 
The central government combined assessment results with 
student promotion rates to create an index of basic edu- 
cation quality (indice de Desenvolvimento da Educacado 
Basica, IDEB) for every school, municipality, state, and 


region in Brazil. Targets based on this index are used by 
system administrators at every level, as well as by parents, 
to hold schools and local administrations accountable for 
learning. 

Better information also raised the incentives for pol- 
iticlans to improve performance. Public awareness of the 
index is high, with the biannual release of IDEB scores 
generating extensive media coverage and debate. This not 
only places education quality high on the political agenda, 
but also makes it an important factor when citizens choose 
their local representatives. 

Crucially, the government also uses the index to target 
low-performing schools for additional support and intro- 
duce programs to motivate system actors. For example, 
schools receive bonuses based on annual improvements in 
IDEB scores, and evidence suggests this move has contrib- 
uted to better learning. 


Sources: WDR 2018 team, based on Bruns, Evans, and Luque (2011); Ferraz and Bruns (2012); OECD (2016); Toral (2016). 


loop described in the next section, schools in areas 
with better access to newspapers benefited the most. 


Good information is also vital for 
monitoring, evaluating, and guiding 
systems 
System managers need information to monitor and 
analyze system performance. School supervisors 
need information on student learning outcomes 
to identify and address poorly performing schools. 
Good research and evaluation on programs and poli- 
cies aimed at improving learning can support better 
implementation by enabling feedback loops. In the 
early 2000s, Cambodia's scholarship program sought 
to improve learning outcomes for disadvantaged 
students. An early evaluation of the program found 
that it improved attainment and narrowed gender 
gaps in enrollment, but it failed to reach the poorest 
children or improve learning.“ In 2006, as a result of 
these findings, the government improved the targeting 
of poorer children. It then experimented with using 
the scholarships to encourage learning. Introducing 
merit-based criteria into student selection increased 
enrollment and improved learning, raising mathemat- 
ics test scores by about 0.17 standard deviations. 
Research and evaluation can also build sup- 
port for effective programs across political cycles. 


Oportunidades, Mexico’s conditional cash transfer 
program, has endured since 1997 despite political 
and economic changes. Because they provided solid 
evidence of how the program improved the lives of 
children, impact evaluations were key to the decision 
to continue the program after a new government was 
elected in 2000." 


But many information and knowledge 
systems are not serving these purposes 
Information needed to improve learning is lacking in 
many countries. An assessment of capacity to mon- 
itor progress toward the Sustainable Development 
Goals found that, of 121 countries, a third lacked data 
on learning outcomes at the end of primary school, 
and half had insufficient information on learning at 
the end of lower secondary school.” Even fewer have 
the data to track these learning outcomes over time. 
Information systems in the education sector, which 
are often weak, are rarely used for decision making, 
planning, or implementation. 

There are many barriers to using information 
to improve learning outcomes. In Tanzania, widely 
publicized results from citizen-led learning assess- 
ments influenced public perceptions of education 
and shifted the government’s focus toward learning 
(box 11.2). Yet such direct links between evidence and 
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Box 11.2 Citizen-led assessments have raised awareness of the learning 
crisis in South Asia and Sub-Saharan Africa 


Citizen-led learning assessments are locally designed mea- 
surements of basic reading and mathematics competen- 
cies. Typically conducted by networks of civil society orga- 
nizations, these assessments test children whether they are 
in or out of school—something that conventional testing 
cannot do. Their goal is to increase awareness of learning 
outcomes and to encourage stakeholders to take action to 
improve learning. Citizen-led assessments have been con- 
ducted mainly in South Asia and Sub-Saharan Africa. For 
example, the Campaign for Popular Education (CAMPE)— 
a network of over 1,000 nongovernmental organizations 
(NGOs), researchers, and educators in Bangladesh—began 
carrying out assessments of this kind in 1999. 
Evaluations of these initiatives concluded that: 


The public finds these assessments more salient than 
larger-scale, more complex national assessments, because 
the citizen-led assessments focus on a narrower set of 
basic competencies, starting with recognizing letters and 
numbers. 


* The initiatives successfully disseminated their results 
and raised awareness about the learning crisis. They also 
increased the focus on learning in government planning 
documents. 

* In India, partnerships between some state governments 
and Pratham, an NGO that seeks to improve education 
quality, have designed interventions to address the prob- 
lems identified by the Annual Status of Education Report 
(ASER) assessment. Moreover, the government of India 
now holds its National Achievement Survey annually 
(rather than once every three years) to track learning 
more frequently. 


While the assessment results have led to action in 
some cases, the link to improved learning is not automatic. 
Over the short period that the ASER in India and Uwezo? 
in Tanzania have been operating, their assessment results 
do not show any clear overall pattern of increases in 
learning—although some Indian states showed significant 
improvements between 2010 and 2016. 


Sources: WDR 2018 team, based on Chowdhury, Choudhury, and Nath (1999); Rath and others (2015); R4D (2015). 


a. Uwezo means “capability” in Kiswahili. 


policy making are often missing."* Some evaluations 
take too long to inform decision making; others 
fail to track key drivers of low system performance. 
Even where usable information exists, government 
agencies may lack the incentives or capacity to use 
it well.’ Independence also matters: reliable, salient 
information can provide incentives for better perfor- 
mance, but biased media may protect the interests 


of particular groups at the expense of better public 
services. In Argentina between 1998 and 2007, news- 
papers that received government funding published 
fewer reports on corruption than did others.”° 

What are the characteristics of an information 
system that promotes learning (table 11.1)? First, infor- 
mation needs to be credible, politically salient, and 
publicly available. Second, clear targets for progress 


Table 11.1 Principles for making the most of information and the roles that actors 


can play 


Principles for making the best use of information 


Roles that different actors can play 


Provide regular, credible, politically salient, and 
publicly available information on learning. 

Set clear targets or expectations for learning, so there 
is a benchmark for judging performance. 


¢ Align information with the political and administrative 
jurisdictions that have authority to act. 


¢ Build information systems that are responsive to the 
policy cycle and facilitate decision making. 


© Government institutions: Produce and disseminate 
national assessment results; conduct in-house 
evaluations; support education research and 
evaluation in external research institutes. 


* Civil society and private sector: Produce and 
disseminate citizen-led learning assessments; use 
assessments and research to support interventions 
that improve learning. 


Source: WDR 2018 team. 
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on learning can strengthen incentives by providing 
measures of system performance. Third, meaningful 
information on learning needs to be aligned with 
political or decision-making power, so that the public 
can hold education decision makers more account- 
able. Finally, information needs to be usable by policy 
makers, administrators, and other system actors— 
that is, it must be timely, accurate, policy relevant, and 
sensitive to the policy cycle. 


Building coalitions and 
strengthening incentives 


Education systems are made up of many actors who 
pursue interests that do not always align with learn- 
ing. Addressing this requires action on two fronts. 
First, coalitions of interest groups are needed to build 
a consensus around the actions that will strengthen 
accountability for better learning. This often requires 
mobilizing support from groups that are not actively 
involved in agenda-setting or that do not engage with 
others. Second, the incentives of bureaucrats and 
other system actors need to align more closely with 
learning (table 11.2). 


Mobilizing support and building coalitions 
to improve learning 
System actors have a better chance of enacting 
reforms when they act collectively. Some actors have 
more power to shift policy toward learning, in part 
because they are better organized.” For example, in 
many countries teachers’ unions have a powerful 
voice in debates on reform, whereas the collective 
voice of parents and students is often muted. 
Mobilizing support and building coalitions of a 
range of system actors have helped to improve learn- 
ing. Many countries have built support for proposed 


policy changes through wide-ranging consultations 
that try to bring together key interest groups.” Peru's 
Business Association for Education organized an 
information campaign that helped shift public 
opinion to support reforms that began in 2006. Gov- 
ernment reformers used information on the poor 
learning outcomes of the education system to mobi- 
lize public support for efforts to strengthen teacher 
accountability, which led to sustained improvements 
in learning.* Alliances between education stakehold- 
ers have also formed in some countries to realize the 
right to education through the legal system (box 11.3). 

Though mobilization efforts can be successful at 
rebalancing interests, they may be less successful at 
shifting the interests of those opposed to reforms. 
Education reform is along process, and well-organized 
opposition can derail it, particularly during implemen- 
tation. In Peru, the government successfully mobilized 
public support to get reforms approved, but it was less 
successful at getting buy-in from teachers, which led 
to continued resistance from teachers’ unions during 
implementation. While the broad reform direction 
remained intact and learning improved, this experi- 
ence highlights a potential trade-off between man- 
aging the politics of reform and getting implemen- 
tation right. When reformers have to devote effort to 
managing opposition, that effort can divert attention 
from implementing reforms well. Lack of buy-in from 
important groups deters them from contributing to 
policy design or implementation, thereby undermin- 
ing the sustainability of the reform.* 

Building broad-based coalitions of stakeholders is 
important at all stages of the policy cycle. Malaysia 
created a performance delivery unit to spearhead 
comprehensive reforms in many sectors, including 
education. The unit uses “labs” that build coalitions of 
stakeholders and involve them in all stages of reform, 


Table 11.2 Principles for building effective coalitions and the roles that actors 


can play 


Principles for building effective coalitions 


Roles that different actors can play 


¢ Mobilize support for reforms through clear 
articulation of the problems of low learning. 

¢ Develop a political strategy to mobilize support and 
build long-term coalitions for learning. 

¢ Avoid direct confrontation in favor of negotiation and 
compensation where possible. 

¢ Encourage strong partnerships between schools and 
communities. 


© Strengthen the capabilities of organizations 
responsible for education services. 


© Government institutions: Develop open, inclusive 
spaces to discuss reform and identify technically and 
politically feasible solutions; build the appropriate 
institutional capacity. 


© Civil society and business organizations: Advocate 
for better education systems; support community and 
parent action at all levels to improve outcomes. 

¢ Teachers and unions: Advocate for system 


improvements; use system knowledge to engage in 
debates on reform. 


Source: WDR 2018 team. 
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Box 11.3 Using the legal system to press for change 


With more than 80 percent of national constitutions rec- 
ognizing the right to education, courts have become an 
increasingly important arena for holding governments 
accountable for education policies and practices. 

In recent years, India and Indonesia have seen a signif- 
icant increase in education rights litigation. In India, this 
trend has been driven by the adoption in 2009 of the land- 
mark Right of Children to Free and Compulsory Education 
Act. Cases have included demands to ensure equal access 
to education, the fulfillment of minimum service standards, 
and assurance that governments will fulfill their spending 
obligations. Many of these cases have been successful. The 
Indian Supreme Court has consistently ruled in favor of 
upholding quotas for poor children in private schools. The 
High Court in Uttarakhand required the state government 
to adopt minimum qualification standards for teachers. 
And in Indonesia, parents succeeded in enforcing consti- 
tutional provisions that obligated the government to spend 
20 percent of its budget on education. 

These cases have often been brought by individuals or 
small groups, with nongovernmental organization (NGO) 
activists and teachers’ unions providing technical and 
financial support. An assessment of the impact of litigation 
of this kind in India and Indonesia found the following: 


Source: WDR 2018 team, based on Rosser and Joshi (2017). 


from design to implementation.* Stakeholders typi- 
cally come together in the labs for six to nine weeks 
at the start of reforms to discuss priorities, agree on 
performance indicators, and produce implementa- 
tion plans. During implementation, minilabs bring 
stakeholders together to adjust plans. Programs intro- 
duced under the process are credited with increasing 
grade 3 literacy rates in Malaysia from 89 percent in 
2009 to close to 100 percent in 2012. The approach has 
been exported to other countries, including India, 
South Africa, and Tanzania (box 11.4). 

Without efforts to build coalitions for learning, 
reforms are less likely to endure. Even if evidence 
shows that the reforms improve learning, their sus- 
tainability is at risk when they are misunderstood or 
unpopular among system actors. In Poland, large-scale 
changes in the structure of the education system were 
introduced in 1999 as part of broader decentraliza- 
tion reforms. These reforms have been credited with 
improving student learning outcomes significantly.” 
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The extent to which the legal system has been used to 
press for policy changes depends significantly on the 
nature of the court system, the presence of support 
structures for legal mobilization, and the ideology of the 
courts. 

Using education rights litigation effectively is condi- 
tional on judges who are open to such cases; civil society 
groups that can help citizens press their claims; and 
broader political mobilization. 

Policy-oriented litigation has mainly served the interests 
of poor or marginalized groups, even though sections 
of the middle class have been centrally involved in 
much of the litigation. Gains have largely come through 
better access to education, although successes have 
often been at the expense of quality education for the 
middle class. 

Litigation as a strategy for improving learning outcomes 
has its limitations. Often, judgments need to be enforced 
by the same public officials who were the target of the 
initial lawsuit. Even when judgments are implemented, 
they are more often about ensuring access than improv- 
ing learning. Courts typically lack the necessary expertise 
on learning, especially where information on learning 
outcomes is scarce. 


At the outset, efforts to build a supporting coalition 
were only half-hearted, and despite the learning gains, 
the reforms have remained unpopular. The election 
of a new government in 2015 led to heated debate 
on whether to scrap key elements of the original 
reforms.’ Building a coalition may require better com- 
munication strategies—or it may require changing 
the reform design, to one that is second-best techni- 
cally but easier to implement and sell to stakeholders. 

A gradual, negotiated approach to reform may 
work better than confrontation. Where coalitions 
of system actors foster collaboration around shared 
goals, reforms are more likely to succeed. The history 
of reforms to improve teaching in Chile demonstrates 
how gradual, negotiated reforms can build strong 
coalitions for change (box 11.5). Since Chile’s return 
to democracy, successive governments have adjusted 
the working conditions of teachers to improve their 
welfare, while also linking pay and career develop- 
ment more closely to performance. These changes 


Box 11.4 Using “labs” to build coalitions for learning 


Rapidly deteriorating results on school-leaving examina- 
tions, together with other newly available information 
on poor system performance, motivated policy makers 
in Tanzania to launch the ambitious Big Results Now in 
Education (BRN) program in 2013. The BRN adopted a 
“service delivery” approach that was first introduced in 
the United Kingdom in the early 1990s and then adapted 
successfully in Malaysia in 2009. 

At the heart of the approach was a six-week-long “lab” 
to identify priority reform areas and develop mutually 
agreed-on delivery plans. The lab brought together all 
the key system actors—government officials, academ- 
ics, teachers’ unions, development partners, civil society 
organizations—at a level senior enough to ensure follow- 
through. Together, the lab participants drafted nine key 
initiatives, developed step-by-step implementation plans, 
and assigned responsibilities for those steps. 


The lab process made it possible to introduce a com- 
plex package of politically sensitive reforms. For example, 
the government introduced monetary and nonmonetary 
incentives to reward the most improved schools, along 
with accountability measures that used public examination 
results to rank schools. The BRN also introduced, for the 
first time, a national sample-based assessment to measure 
early grade literacy and numeracy. Communication cam- 
paigns succeeded in generating very high levels of public 
awareness of the BRN’s objectives nationwide. 

Although the program has been running for only four 
years, there are signs that it has begun to improve learning 
outcomes. However, the program has not been without its 
difficulties; for example, a recent review highlighted the 
difficulties in coordination between the government agen- 
cies responsible for education. But over the past few years, 
examination results have slowly improved, and primary 
school students have made gains in early grade reading. 


Sources: WDR 2018 team, based on Sabarwal, Joshi, and Blackmon (2017); Todd and Attfield (2017); World Bank (2017b). 


Box 11.5 Reformers in Chile negotiated changes gradually 


In the early 2000s Chile’s education system registered sig- 
nificant, sustained improvements in learning levels. The pro- 
portion of 15-year-olds who achieved reading scores at or 
above a Programme for International Student Assessment 
(PISA) level of proficiency increased from 52 percent to 
69 percent between 2000 and 2015 (figure B11.5.1). 

Much of the improvement was attributable to the 
Sistema Nacional de Evaluacién de Desempefio (National 
Performance Evaluation System; SNED) program imple- 
mented in 1996. This program began by awarding teacher 
bonuses based on school-level indicators of performance. 
In 2004 individual teacher incentives were introduced, 
based on mandatory performance evaluations of public 
school teachers. By the end of the 2000s, these incentives 
accounted for 15-25 percent of the average teacher salary. 
Rigorous evaluations of the group-based program revealed 
that the incentives significantly improved student learning. 

The gradual shift from school to individual incentive 
payments was a pragmatic attempt to address the potential 


Figure B11.5.1 Reading scores have 
improved in Chile 
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Box 11.5 Reformers in Chile negotiated changes gradually (continued) 


opposition of teachers’ unions to performance-related pay. 
Before implementing a mandatory program for all teachers, 
the administration introduced a voluntary individual assess- 
ment and incentive system that set a precedent for teacher 
evaluation. Because these steps allowed time to adjust and 
gain support for the new system, they were key to its success. 

Establishing credibility with the teachers’ union early 
on was another key strategy. The Teacher Statute passed in 
1991 conferred civil service status on teachers, guarantee- 
ing associated job benefits, protection, and an opportunity 
for centralized wage negotiations. This move sent a positive 
signal to teachers. Trust between the union and the govern- 
ment increased further through regular discussions on the 
implementation of reforms. As part of these efforts, union 
members codesigned the performance evaluations used for 
the incentive program. 


A final factor in the successful adoption of these reforms 
was their inclusion in a broader set of reforms that increased 
resources for education and raised teachers’ salaries. SNED 
became part of the teacher professionalism pillar of the Full 
School Day reform package. More teachers were covered 
by the reforms, and the incentive amount was increased. 
Salary increases before the start of the program may have 
helped to lessen opposition to the mandatory individual 
pay incentive. 

As a consequence, the Chilean programs remain one of 
the few long-running “pay for performance’-type reforms 
that have been successfully scaled to the national level. In 
other contexts, such reforms have often been unpopular, 
but in Chile the reforms continue: in 2016 new legislation 
passed to widen the coverage of the incentive program, 
while strengthening teacher professional development. 


Sources: WDR 2018 team, based on Avalos and Assael (2006); Contreras and Rau (2012); Delannoy (2000); Mizala and Schneider (2014); OECD (2016); 


World Bank (2017a). 


have contributed to Chile’s steady improvement in 
international learning assessments. 

Negotiations can also include strategies to com- 
pensate actors disadvantaged by reform. One such 
strategy is to provide targeted assistance to students 
harmed by reforms to improve system efficiency. 
Additional services for children affected by school clo- 
sures, for example, can ease school consolidations.” 
Another strategy is to use “dual-track” reforms to pro- 
tect some incumbents from the negative impacts of 
reforms. For example, pay-for-performance programs 
in Peru and in the District of Columbia in the United 
States were initially introduced voluntarily. 

Compensating perceived losers can help get 
reforms approved, but that approach comes with 
risks. In 2005 the Indonesian government introduced 
a comprehensive reform program aimed at raising 
the competencies of teachers. Teacher certification 
was the centerpiece of the reforms, with teachers 
required to pass a competency test to continue teach- 
ing.”? In exchange for these new obligations, the nego- 
tiated agreement provided certified teachers with an 
additional monthly allowance as large as their base 
salary. But early in implementation, the requirements 
for certification were diluted because of political pres- 
sures, so that teachers were no longer required to pass 
a competency test. In the end, the reforms had little 
impact on teacher competencies or student learning, 
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but they had a major impact on public spending.” 
By 2011, with less than a third of teachers certified, 
9 percent of the education budget already went to 
certification allowances." 


Building partnerships between schools and 
communities 

Sustained reform requires strong partnerships 
between schools and communities. Where incentives 
for systemwide reform are weak, local action can 
substitute. In South Africa, the political and economic 
context has constrained efforts to improve education 
performance in some provinces, but local progress has 
been made possible in some schools through strong 
partnerships between parents and schools. Local 
partnerships are particularly important in fragile 
and conflict-affected areas.8 For example, a program 
that built community-based schools in Afghanistan 
reduced the distance to school, increased enrollment, 
and improved learning outcomes, particularly for 
girls.3+ Yet these local partnerships tend to work best 
when supported by responsive higher-level institu- 
tions, which are sorely lacking in fragile environments. 


Aligning the incentives and capacity of 
system actors with learning 

The success of reforms depends on the ability, incen- 
tives, and motivations of public officials. Managing 


education systems effectively requires competent 
public service-oriented personnel, which in turn 
means commensurate pay and working conditions.* 
But if the political economy of education is misaligned 
with public goals, candidates with less desirable attri- 
butes may be attracted to public service. In Mexico, 
teachers were often hired based on political patronage 
rather than merit, which resulted in lower-quality 
hires compared with those in test-based systems.*° 

Efforts to build the capacity of bureaucracies have 
been disappointing.” Even where individual capac- 
ity is built successfully, the incentives to use this 
capacity to develop and implement effective policies 
are often absent.* Put another way, building organi- 
zational capability to improve education outcomes 
tends to work best when incentives in education sys- 
tems are aligned with the same goals. For example, 
where politicians face stronger incentives to provide 
public goods, this has inspired efforts to build pro- 
fessional bureaucracies that can deliver better public 
services.*? 


Encouraging innovation 
and agility 


Political and technical complexities make it chal- 
lenging to design and implement policies to improve 


learning. Some parts of the solution to low learning 
are relatively straightforward. Inadequate infrastruc- 
ture and learning materials, while logistically chal- 
lenging, can be addressed directly: the technologies 
needed are well known, and most education systems 
have enough experience solving these issues. But 
improving what happens in the classroom is much 
harder. It involves changing student and teacher 
behavior, as well as supporting teachers in efforts to 
tailor their teaching to the needs of their students. 
The traditional approaches to reform—in which pre- 
defined interventions are introduced with little room 
to adapt during implementation—are rarely effective. 

Learning reforms need a more agile approach, 
with room for adaptation.’ This is not the same as 
experimenting with different interventions in pilot 
projects. Rather, it means testing approaches at scale 
in their political and economic contexts and using 
the existing capabilities of implementing agencies. 
A recent review of complex public management 
reforms, including in education, highlighted the 
key elements of successful reforms.” Those reforms 
started out with a clear articulation of the problem, 
together with an initial set of potential solutions, and 
then adopted solutions that emerged from experi- 
mentation during implementation (figure 11.2). Final 
interventions tended to be hybrids, drawing on local 
and global evidence. 


Figure 11.2 Problem-driven iterative adaptation drives successful reforms 
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Searching for solutions to local problems 
All systems have some parts that work well; these 
parts can be used to identify technically and polit- 
ically feasible approaches to improving learning. 
In Misiones Province, Argentina, student dropout 
rates were high. But some schools bucked the trend: 
teachers agreed on informal learning contracts with 
parents instead of blaming them for poor student 
performance. Schools that adopted more constructive 
approaches to parent-teacher relations saw dropout 
fall significantly.* Schools approach challenges in 
different ways, so analysis of positive outliers could 
be useful for policy making (box 11.6). 

Local innovations, however, may not be enough to 
close the learning gap between countries. Employing 
principles from the growing global knowledge can 
provide useful ideas for improving learning in spe- 
cific contexts. A more iterative approach to system 
change can be a way to adapt interventions inspired 
by global experiences to local contexts. 


Integrating an iterative and adaptive 
approach to policy making and 
implementation 

Recent examples show how an iterative, adaptive 
approach can strengthen education systems and 


improve learning. In India, an experiment showed 
that grouping children by ability and using level- 
appropriate teaching along with continual assess- 
ment improved students’ reading abilities. Recogniz- 
ing that a small-scale experiment was no guarantee of 
success in the government system, Pratham—the 
NGO responsible for the original evaluation—experi- 
mented with different approaches to level-appropriate 
teaching in government schools. This experimenta- 
tion tested the assumptions of the original model and 
identified factors behind the earlier success. It then 
identified two approaches to implementation that 
could work at scale. Even in fragile states, where 
system capabilities are limited, iterative approaches 
like this have been successful at restoring essential 
education services (box 117). 

Policy makers can test policies before introducing 
them more widely. Whole-system reforms are difficult 
to evaluate because they lack an appropriate counter- 
factual, making it difficult to trace the impacts of policy 
change and adapt strategies to improve learning. Small 
pilots can overcome these difficulties, but it is hard to 
assess whether they will be effective without the atten- 
tion and nurturing that can occur ina pilot. As a middle 
way, China and other countries have tested new poli- 
cies in specific regions. Policy makers first identify 


Box 11.6 High-performing schools in the West Bank and Gaza offer some 


learning lessons 


The United Nations Relief and Works Agency (UNRWA) 
provides over 300,000 refugees in the West Bank and 
Gaza with basic education services. In multiple rounds of 
international assessments, UNRWA schools outperformed 
public schools, delivering the equivalent of one year’s addi- 
tional learning despite the lower socioeconomic status of 
UNRWA students and lower per student spending.’ Drivers 
of their better performance include: 


* Greater parental involvement in school activities and a 
close partnership between schools, households, and ref- 
ugee communities, which contributes to a shared sense 
of purpose and collaborative mechanisms for monitoring 
and support. 

More effective teacher support systems. Teachers are 
trained using standards that clearly articulate what 
students should know and be able to do in each grade. 


Source: WDR 2018 team, based on Abdul-Hamid and others (2016). 
a. This comparison is for UNRWA schools and public schools in Jordan. 
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Although preservice training is similar in UNRWA and 
public schools, UNRWA teachers complete a two-year 
training program in classroom instruction, resulting 
in teaching approaches that are better aligned with 
learning. 
* Assessment and evaluation. UNRWA schools have 
more rigorous, more frequent student assessments and 
teacher evaluations than public schools. 
Effective school leadership. UNRWA invests in develop- 
ing qualified principals who can support their teachers 
effectively. 


Identifying lessons from high-performing schools is not 
always easy. Some factors such as school leadership that 
drive high performance may be idiosyncratic, making them 
hard to replicate. Drawing on large samples of schools can 
help identify more generalizable lessons. 


Box 11.7 Burundi improved education services by iterating and adapting 


After a protracted civil war and long peace process in 
Burundi, a new government and new constitution in 
2005 led to a renewed emphasis on public services. Many 
schools had been destroyed, and management systems 
had collapsed. As the new government took office, primary 
net enrollment rates stood at just 56 percent, student- 
classroom ratios were 87:1, and 20 students shared a single 
mathematics textbook on average. 

The government prioritized reducing the high student- 
textbook ratios and delays in delivery as part of a broader 
rapid-results initiative that had three stages: 


* Shaping. |In this stage, a reform team identified why 
there were not enough textbooks. To ensure practical 
solutions, the team comprised stakeholders from across 


the education system, including provincial education 
directors and parent-teacher associations. 

« Implementation. Senior government officials gave the 
team authority to implement its new approach in a sin- 
gle province. As implementation progressed, the team 
regularly adjusted its action plan. 

* Planning for sustainability. After reviewing the interven- 
tion’s performance, senior government officials decided 
how to scale up the program to other provinces. 


The initiative far exceeded its targets. Textbook avail- 
ability increased, and average delivery times fell from over 
a year to 60 days. This success led to similar initiatives to 
tackle teacher payroll problems, as well as many other ser- 
vice delivery problems beyond education. 


Source: WDR 2018 team, based on Campos, Randrianarivelo, and Winning (2015). 


the main problems; then they agree on which solutions 
to subject to experimentation. They develop proposals 
for experiments, in part by analyzing solutions adopted 
in other countries to tackle similar issues, with differ- 
ent regions trying alternatives. Successful policies 
are then rolled out to other regions. Belgium and the 
Netherlands have adopted similar approaches. 
Giving stakeholders the authority and autonomy 
to adopt such approaches runs counter to how many 
education agencies operate. Closed systems limit the 
autonomy of system actors and judge performance 
based on compliance with formal rules over resource 
use, leaving little room for innovation. By contrast, 
more open systems that have a sharper focus on 


outcomes are more likely to see greater innovation 
across the education system (table 11.3).*° 


Good information systems and 
broad-based coalitions are also needed 

A capacity to learn from the implementation of new 
innovations is vital. Information systems that pro- 
vide rapid, regular, accurate feedback are crucial for 
more adaptive approaches to improving learning. 
Some countries are beginning to build these kinds 
of capabilities into their education agencies. Peru's 
MineduLAB in the Ministry of Education is a collabo- 
ration between government agencies and experienced 
researchers. 4” The lab introduces innovations directly 


Table 11.3 Principles for encouraging innovation at scale and the roles that actors 


can play 


Principles for encouraging innovation and agility in 
approaches to improving learning 


Roles that different system actors can play 


¢ Adopt a more iterative and adaptive approach to the 


design and implementation of policies. 
Identify promising solutions from within the education 
system, as well as the global knowledge base. 


Establish information systems that provide rapid 
feedback to support implementation. 


Develop the capability of education agencies, an 
enabling environment, and autonomy to encourage 
innovation. 


Source: WDR 2018 team. 


© Government institutions: Develop an enabling 
environment and incentives for innovation and a 
more iterative approach. 


* Civil society and private sector providers: Experiment 
with different approaches to improving learning. 
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into government schools, and information from min- 
istry systems (rather than individual data collection 
exercises) must be used by researchers to evaluate the 
new programs. Results must also be available within 
the same academic year. In MineduLAB’s first year, 
innovations included providing more comparative 
information on school performance and introducing 
modules to encourage primary school students to 
adopt a growth mindset. The program is still new, but 
its approach is promising. 

To be sustainable, these approaches need broad sup- 
port. Though this iterative approach can help in devel- 
oping more effective strategies, it comes with risks 
for actors in education systems. Politicians can incur 
significant costs if experiments fail or divert resources 
away from more traditional activities. Students can 
also suffer if new approaches disrupt their schooling 
without improving it. Yet some risk-taking is vital if 
education systems are to improve learning. Mobilizing 
stakeholder support and providing space for consulta- 
tions from the outset can reduce the risks. 


Education systems need to be agile to 
exploit critical moments 

Politicians and education system managers also 
need to respond quickly when changes create 


opportunities to improve broad-based learning. 
This context changes infrequently, but when it does 
change it provides opportunities for significant 
changes in education policy. During the martial 
law period of the 1970s in the Philippines, govern- 
ment spending on education fell below 2 percent 
of the gross domestic product (GDP). In the 1980s, 
the People’s Power Revolution restored democratic 
rule, ushering in a new government that was more 
responsive to demands for broader access to edu- 
cation. Trade liberalization increased the demand 
for skilled workers, further raising the incentives 
for better education. With these societal shifts, 
public investment in education increased by 2 
percentage points of GDP between 1980 and 2000 
(figure 11.3). 

Critical junctures often arise from broader decen- 
tralization and reform efforts, as in the education 
reforms in Latin America during the 1990s.** Beyond 
shifting responsibility for education services to local 
governments and schools, decentralization can pro- 
vide opportunities to better align important elements 
of education systems. After early decentralization 
reforms in Poland, the government introduced 
formula-based funding mechanisms to link school 
funding levels more closely to school needs. This 


Figure 11.3 Trends in public education spending in the Philippines track changes in 
the broader political and economic context 


Public education spending as percentage of GDP, and measures of democracy and trade openness, the Philippines (1960-2000) 
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Note: Level of democracy is measured by the polity score, which consists of an evaluation of the competitiveness and openness of elections, the nature of 
political participation in general, and the extent of checks on executive authority. A high positive score corresponds to strong democratic institutions; negative 
scores indicate more autocratic systems. Trade openness is measured by the inverted Hiscox Kastner score, which gauges the degree to which a country 
deviates from an optimal level of imports from a hypothetical protection-free environment. Higher scores indicate greater openness. 
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shift aligned funding with new realities, helping the 
system reduce inefficiencies.‘ 

To innovate effectively—as indeed to build coa- 
litions and use information for reform—education 
systems need strong, competent leadership. Research 
highlights three key attributes of effective leaders. 
First, they can clearly articulate problems and pres- 
ent clear visions for how to tackle them. Second, 
they mobilize human and financial resources around 
agreed-on goals and build coalitions to advocate for 
change and support implementation. Finally, effec- 
tive leaders focus on identifying solutions that fit the 
institutional context.*° 


How can external actors 
support initiatives to 
improve learning? 


Support the creation of objective, 
politically salient information 

Global education initiatives can improve political 
incentives for action. The Millennium Develop- 
ment Goals (MDGs) were ssuccessful at mobilizing 
international and domestic actors on development 
challenges. Though the global impact of the MDGs— 
including the education goal—is still being debated, 
the legitimacy that progress could confer on weak or 
unstable governments was often a powerful incentive 
for change. Many countries introduced reforms to 
expand access to schooling in successful efforts to 
meet the MDGs. The Sustainable Development Goal 
(SDG) indicators, which will include a set of compa- 
rable learning measures, could play a similar role by 
motivating countries to shift their focus from school- 
ing to learning. 

By supporting improvements in learning assess- 
ment, external actors can help shine a light on low 
learning levels and their causes. For one thing, they 
can help developing countries participate in regional 
and global assessments, which are an important tool 
for opening up spaces for change and influencing 
policy debates." They could also help ensure that test 
items are linked across countries and across time, 
which would allow results of different assessments 
to be more comparable. External actors can also help 
by supporting national assessment efforts, so that 
they can provide more politically salient information 
on learning. The READ program, a partnership among 
development partners, education practitioners, and 
low-income country governments, has helped coun- 
tries strengthen their national assessments, while 


also supporting their participation in international 
assessments.” 

Beyond support to measure learning, external 
actors can also help build global knowledge on ways 
to diagnose system weaknesses and improve learn- 
ing. This knowledge base has expanded rapidly, but 
more research is needed on how to adapt promising 
interventions to specific contexts. External actors can 
fund research and encourage collaboration among 
practitioners, researchers, and government institu- 
tions to build capacity and locally relevant knowledge 
on effective ways to improve learning. 


Encourage flexibility and support reform 
coalitions 

External actors can also encourage inclusive reforms 
through project development activities, policy dis- 
cussions, and support to other system actors. Though 
there has been much progress on the aid effective- 
ness agenda first agreed on in the Paris Declaration 
in 2005, there is still room for improvement. A key 
aspect of this agenda is building inclusive reforms. 
But progress in this area has been slow. Across all sec- 
tors, only about half of countries were judged to have 
systems for meaningful dialogue with civil society 
organizations. Moreover, dialogue between the pub- 
lic and private sectors was judged to be difficult and 
rarely led to action. Tackling these issues is vital for 
the emergence of the coalitions needed to design and 
implement effective policies. 

In education, consultative groups and civil society 
organizations could promote more inclusive reforms. 
The Civil Society Education Fund (CSEF), launched in 
2009, has supported national education coalitions in 
more than 40 developing countries, and the number 
of civil society organizations involved in education 
planning and policy has expanded rapidly.5+ For 
example, the fund has supported the Ghana National 
Education Campaign Coalition (GNECC) in lobbying 
for more participatory education planning, policy 
formulation, and monitoring. GNECC members have 
worked together to present new findings on educa- 
tion issues during annual education review meetings 
and to advocate for change.* 


Link financing more closely to results that 
lead to learning 

While the overall contribution of development 
assistance to country investments in education is 
relatively small, it is important in some low-income 
countries (figure 11.4). In 2015 international finance 
accounted for 14 percent of education spending in 
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Figure 11.4 Most funding for education 
comes from domestic sources, but 
international finance is important for 
low-income countries 


Estimated sources of education spending, by income group 
(2015) 


100 


80 


60 


Percent 


40 


20 


Upper-middle- 


income 


Lower-middle- 
income 


Low-income 


& International finance 
© Households 
™ Domestic public 


Source: Education Commission (2016). Data at http://bit.do/WDR2018 
-Fig_11-4. 


low-income countries. But support is much higher 
in some countries. In Mali, development assistance 
accounted for approximately 25 percent of public 
education spending between 2004 and 2010. More- 
over, global estimates of the investments required 
to raise learning as part of the SDGs imply a need 
to increase development assistance, particularly to 
low-income countries. 

But external actors must provide financing in 
a way that aligns systems with learning. Projects 
aimed at narrow aspects of reform or on specific 
interventions, run the risk of exacerbating existing 
misalignments, if weaknesses in other parts of the 
system are not tackled at the same time. For exam- 
ple, projects that support professional development 
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activities but are not aligned with career development 
incentives are likely to be less sustainable. External 
actors can support alignment by shifting the focus of 
systems toward learning, linking their financing to 
results rather than the provision of specific inputs or 
activities. 

More development partners are using results- 
based financing in education. These approaches seek 
to align system components by linking financing to 
results. They shift the emphasis from inputs toward 
performance. Some financing is linked directly to 
student achievement. For example, a U.K. program 
that supports the education system in Ethiopia pro- 
vides an agreed-on amount for net increases in the 
number of students who pass the examination at the 
end of lower secondary education. The multidonor- 
financed Big Results Now in Education program in 
Tanzania links financing to student learning and to 
intermediate outputs that support improvements 
in education quality. The ultimate impact of these 
approaches on system performance is still being 
evaluated, since they are new. But initial findings 
suggest they have the potential to tackle system-level 
constraints and improve system performance.’ 


kK 


There is nothing inevitable about poor learning out- 
comes, whatever a country’s level of development. 
Some countries have used well-documented reforms 
to escape low-learning traps, successfully reorienting 
their systems toward learning. Others have achieved 
learning outcomes that far exceed what their develop- 
ment level would predict, indicating that they escaped 
the trap in the past. Though there is no single recipe 
for achieving broad-based learning, these cases iden- 
tify three entry points for getting under way. First, 
deploy information and metrics to shine a light on the 
hidden exclusion of low learning. Second, build coali- 
tions that can better align incentives toward learning, 
especially the learning of the most disadvantaged. 
Third, commit to innovation and agility, using feed- 
back loops for continuous improvement. None of this 
is easy, but history shows that achieving education's 
promise will depend on taking up the challenge. 
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